Desktop streaming performance and transcript length costs
NousResearch/hermes-agent · cluster 69120 · apps/desktop
Data as of
Nothing open on GitHub. Fix merged in #71780. Check it covers your case.
The short answer
- Known?
- Yes. 6 related items grouped here, 1 issue already closed.
- Fix event
- A fix was merged to main in PR #71780. Check it covers your case. No release data is tracked.
- Tracker
- The maintainers' tracker marks this
resolved, deciding PR #71835. That is separate from the fix event. - Still open
- Nothing open on GitHub.
These issues and pull requests address performance problems in desktop streaming sessions, specifically that processing costs grew with transcript/history length. Work focuses on reducing redundant computation during streaming, such as re-extracting settled prompts and running timeline work unnecessarily.
Open issues0
Open PRs0
Fixes on record
-
#71780 perf(desktop): make multitab streaming sessions fast
files:
apps/desktop/scripts/perf/scenarios/index.mjs,apps/desktop/scripts/perf/scenarios/multitab.mjs,apps/desktop/src/app/chat/index.tsx,apps/desktop/src/components/assistant-ui/thread/timeline.tsx,apps/desktop/src/components/pane-shell/pane-visibility.ts,apps/desktop/src/components/pane-shell/tree/renderer/tree-group.tsx -
#71789 perf(desktop): stop the thread timeline working when nothing can see it
files:
apps/desktop/src/components/assistant-ui/thread/timeline-data.test.ts,apps/desktop/src/components/assistant-ui/thread/timeline-data.ts,apps/desktop/src/components/assistant-ui/thread/timeline-idle.test.tsx,apps/desktop/src/components/assistant-ui/thread/timeline.tsx -
#71835 perf(desktop): make streaming cost independent of transcript length
files:
apps/desktop/scripts/perf/scenarios/index.mjs,apps/desktop/scripts/perf/scenarios/stream-history.mjs,apps/desktop/scripts/perf/scenarios/stream.mjs,apps/desktop/src/app/chat/runtime-repository.ts,apps/desktop/src/app/session/hooks/use-message-stream/index.ts,apps/desktop/src/app/session/hooks/use-message-stream/stream-flush.test.tsx,apps/desktop/src/lib/incremental-external-store-runtime.test.ts,apps/desktop/src/lib/incremental-external-store-runtime.ts
2 PRs closed without merging
From the close comments: superseded by another PR 1 · other 1
Closed issues · 1
- Closed#69120Desktop streaming cost grows with transcript length
How this cluster was grouped
-
Link evidence (
structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference. -
Pairwise link density
0.40: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36.1.00means every pair is linked.
Pick up a Lab task
Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.
Open the Lab