Cairn

Sherpa KWS tokenizer type not auto-detected

NousResearch/hermes-agent · cluster 110003 · agent

Data as of

3 open items. Fix attempted, not merged.

The short answer

1open issue
2open PRs
3items grouped
Known?
Yes. 3 related items grouped here, 0 issues already closed.
Fix event
No fix has been merged to main. see the attempts below.
Tracker
The maintainers' tracker marks this unresolved. That is separate from the fix event.
Still open
1 issue and 2 PRs.

A bug where the Sherpa keyword spotting engine hard-codes BPE tokenization causes non-BPE models (e.g. Chinese WenetSpeech) to fail, with accompanying fixes to detect the tokenizer layout from the model directory.

Open issues1

  • Issue#110003[Bug]: Wake word: sherpa KWS hard-codes tokens_type="bpe" — any model without bpe.model crashes the engine (Chinese wenetspeech model never starts)

Open PRs2

  • PR#110087fix(tools): support non-BPE Sherpa wake vocabularies
  • PR#124849fix(wake-word): pick the sherpa KWS tokenizer layout from the model directory
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Subsystem
agent
Closed issues
0
Attempts
0 PRs closed without merging

For your agent

The same facts, typed.

cluster/110003.json
cluster/110003.md