Cairn

Per-provider request rate and concurrency controls

NousResearch/hermes-agent · cluster 108596 · agent

Data as of

3 open items. Fix attempted, not merged.

The short answer

1open issue
2open PRs
3items grouped
Known?
Yes. 3 related items grouped here, 0 issues already closed.
Fix event
No fix has been merged to main. see the attempts below.
Tracker
The maintainers' tracker marks this unresolved. That is separate from the fix event.
Still open
1 issue and 2 PRs.

These items address adding per-provider configuration for maximum in-flight requests and requests per minute, and handling contention when multiple concurrent requests target the same local or self-hosted model backend.

Open issues1

  • Issue#108596Concurrent calls to the same local/self-hosted model backend contend and stall instead of queueing

Open PRs2

  • PR#108722fix(agent): serialize concurrent requests to the same local backend
  • PR#128816feat(agent): per-provider max_in_flight and requests_per_minute request admission
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Subsystem
agent
Closed issues
0
Attempts
0 PRs closed without merging

For your agent

The same facts, typed.

cluster/108596.json
cluster/108596.md