NousResearch/hermes-agent

VRAM-based resident model cap for local runtime

Cluster 116078. Data as of 2026-10-26 12:29 UTC

Nothing open on GitHub. Fix merged in #117656 on 21 Sep 2026. Check it covers your case.

open issues

open PRs

items grouped

Known?: Yes. 3 related items grouped here, 1 issue already closed.
Fix event: A fix was merged to main in PR #117656. Check it covers your case. No release data is tracked.
Tracker: The maintainers' tracker marks this resolved, deciding PR #117656. That is separate from the fix event.
Still open: Nothing open on GitHub.

Next step: read #117656, then check it covers your case.

Read #117656 Pick up a Lab task

A bug was identified where the local runtime admitted resident models by count rather than available VRAM, causing silent paging and slowdowns on limited-memory cards. The fixes derive the residency cap from actual VRAM and staged model sizes rather than a simple count ceiling.

Open issues0

No open issues.

Open PRs0

No open pull requests.

Fixes on record

Merged to main. A stamp counts the issues a fix is linked to.

#117656 fix(local-runtime): resident model cap derives from VRAM with models_max as the ceiling (#116078, salvage #116350)

merged to main

files: hermes_cli/local_runtime/bootstrap.py, hermes_cli/local_runtime/presets.py, tests/hermes_cli/test_local_residency_admission.py

1 PR closed without merging

From the close comments: merged via another change 1

#116350 fix(local-models): derive the residency cap from the card and the staged models, not the count alone · merged via another change → 1142a5b, #117656

Closed issues · 1

Closed#116078[Bug]: Managed local runtime admits models by count, not by VRAM — on an 8 GB card the second resident is silently paged (2.6× slower)

How this cluster was grouped

Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Merged PRs: #117656
Closed issues: 1
Attempts: 1 PR closed without merging
Fix link checked: 21 Sep 2026

For your agent

The same facts, typed.

cluster/116078.json
cluster/116078.md