Cairn
NousResearch/hermes-agent

Fix token estimates for East Asian fullwidth text

Cluster 58784 · agent. Data as of

3 open items. Fix attempted, not merged.

The short answer

1open issue
2open PRs
3items grouped
Known?
Yes. 3 related items grouped here, 0 issues already closed.
Fix event
No fix has been merged to main. see the attempts below.
Tracker
The maintainers' tracker marks this unresolved. That is separate from the fix event.
Still open
1 issue and 2 PRs.

These issues and pull requests address undercounting of East Asian fullwidth and CJK characters in rough token estimates. Fixes apply conservative weighting or corrected character counting to improve estimate accuracy.

Open issues1

  • Issue#58784Rough token estimates undercount East Asian fullwidth text

Open PRs2

  • PR#58785fix(context): count fullwidth chars in estimates
  • PR#61543fix(agent): weight East Asian fullwidth/CJK text conservatively in token estimate
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Subsystem
agent
Closed issues
0
Attempts
0 PRs closed without merging

For your agent

The same facts, typed.

cluster/58784.json
cluster/58784.md