{"repo":"NousResearch/hermes-agent","public_id":"137685","display_label":"MTP models spilling lose large prefill microbatch setting","summary":"These items concern local-runtime handling of MTP models that are too large for the card and spill. One reports that the child process launches without -b/-ub flags (falling back to the engine default of 512), and the two fix-titled items appear to address retaining the large prefill microbatch in that case.","subsystem":"hermes_cli","counts":{"members":4,"open_issues":1,"open_issues_distinct":1,"open_prs":2,"closed_issues":0,"merged_prs":0,"attempt_prs":3},"landed_fix":null,"resolution":{"state":"unresolved","by":null},"freshness":{"state":"never_verified","last_verified_at":null,"is_stale":false},"grouping":{"backbone":"STRUCTURAL_SPANNING","link_density":0.5},"fix_edges":[],"members":[{"kind":"issue","number":137685,"title":"[Bug]: MTP models too large to fit the card never get the large prefill microbatch — child launches with no -b/-ub (engine default 512)","url":null,"state":"open"},{"kind":"pr","number":137689,"title":"fix(local-runtime): retain MTP prefill when spilling","url":null,"state":"open","close_reason":{"category":"silent_close","implication":"active"},"merged":false},{"kind":"pr","number":137694,"title":"fix(local-runtime): an MTP model that spills in both postures keeps the large prefill microbatch","url":null,"state":"closed","close_reason":{"refs":[{"kind":"pr","value":"#137689","number":137689},{"kind":"pr","value":"#137689","number":137689}],"category":"superseded_by_pr","implication":"superseded"},"merged":false},{"kind":"pr","number":141542,"title":"fix(local-runtime): an MTP model that spills in both postures keeps the large prefill microbatch","url":null,"state":"open","close_reason":{"refs":[{"kind":"commit","value":"18d42bcc46d66b8c7d09c5c56b41e92785981e8a","number":0}],"category":"uncategorized","implication":"needs_llm"},"merged":false}],"trust":{"default_tier":"verified","includes_suggested":false}}