Cairn
NousResearch/hermes-agent

Sticky routing bug causing poor prompt cache hit rates

Cluster 71576. Data as of

Nothing open on GitHub. Fix attempted, not merged.

The short answer

0open issues
0open PRs
3items grouped
Known?
Yes. 3 related items grouped here, 1 issue already closed.
Fix event
No fix has been merged to main. 2 PRs closed without merging; see the attempts below.
Tracker
The maintainers' tracker marks this unresolved. That is separate from the fix event.
Still open
Nothing open on GitHub.

A bug in Nous Portal caused sticky routing to use incorrect keys, resulting in prompt cache misses and significantly higher costs for Anthropic models. The fixes address routing key stabilization and a related lock-holder issue on Windows.

Open issues0

No open issues.

Open PRs0

No open pull requests.

2 PRs closed without merging

From the close comments: closed without comment 1 · superseded by another PR 1

  • #71708 fix(nous-portal): key sticky routing on the lineage root, not the segment · closed without comment
  • #71747 fix(nous-portal,compression-lock): stabilize Hermes's sticky-routing key + reclaim crashed lock holders on Windows · superseded by another PR
Closed issues · 1
  • Closed#71576[Bug]: Nous Portal does not apply provider sticky routing for Anthropic models — prompt caches are written but never read (39% vs 100% hit rate, ~2.3x cost)
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Closed issues
1
Attempts
2 PRs closed without merging

For your agent

The same facts, typed.

cluster/71576.json
cluster/71576.md