Cache model endpoint probes and credential loads for speed
Cluster 72762 · hermes cli. Data as of
Nothing open on GitHub. Fix merged in #81113 on 7 Aug 2026. Check it covers your case.
The short answer
- Known?
- Yes. 4 related items grouped here, 1 issue already closed.
- Fix event
- A fix was merged to main in PR #81113. Check it covers your case. No release data is tracked.
- Tracker
- The maintainers' tracker marks this
resolved, deciding PR #81113. That is separate from the fix event. - Still open
- Nothing open on GitHub.
These items address performance problems with the /model command being slow due to uncached credential-pool loads, live Copilot token exchanges on every open, and custom provider /v1/models probes bypassing the disk cache. The work involves adding caching at multiple layers to reduce redundant network and auth overhead.
Open issues0
Open PRs0
Fixes on record
-
#81113 perf(model): disk-cache custom-provider /v1/models probes (#72762, salvage of #80740)
files:
acp_adapter/server.py,hermes_cli/model_switch.py,hermes_cli/models.py,tests/hermes_cli/test_cached_fetch_api_models.py,tests/hermes_cli/test_model_switch_custom_providers.py,tests/hermes_cli/test_picker_prewarm.py,tests/hermes_cli/test_user_providers_model_switch.py
2 PRs closed without merging
From the close comments: merged via another change 1 · other 1
Closed issues · 1
- Closed#72762[Bug]: /model is slow for all users: uncached credential-pool loads + live Copilot token exchange on every open, plus custom_providers bypass disk cache
How this cluster was grouped
-
Link evidence (
structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference. -
Pairwise link density
0.50: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36.1.00means every pair is linked.
Pick up a Lab task
Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.
Open the LabAt a glance
- Subsystem
- hermes cli
- Merged PRs
- #81113
- Closed issues
- 1
- Attempts
- 2 PRs closed without merging
- Fix link checked
- 7 Aug 2026