NousResearch/hermes-agent

CI timeout tuning for slow generation tests

Cluster 52332 · agent/pet. Data as of

Nothing open on GitHub. Fix merged in #54143 on 28 Jun 2026. Check it covers your case.

The short answer

0open issues
0open PRs
3items grouped
Known?
Yes. 3 related items grouped here, 1 issue already closed.
Fix event
A fix was merged to main in PR #54143. Check it covers your case. No release data is tracked.
Tracker
The maintainers' tracker marks this unresolved. That is separate from the fix event.
Still open
Nothing open on GitHub.

These items address test timeouts in CI, particularly around a slow model generation path that causes false failures under shard contention. Changes involve raising per-file and generation timeouts to reduce flakiness.

Open issues0

No open issues.

Open PRs0

No open pull requests.

Fixes on record

Merged to main. A stamp counts the issues a fix is linked to.

  • #54143 test(ci): raise per-file timeout 140s → 300s to stop false timeouts

    merged to main

    files: infographic/ci-file-timeout-300/infographic.png, scripts/run_tests_parallel.py

    Show the diff
    • scripts/run_tests_parallel.py
      @@ -74,7 +74,16 @@
       
       # Per-file wall-clock cap. Override
       # via --file-timeout or HERMES_TEST_FILE_TIMEOUT.
      -_DEFAULT_FILE_TIMEOUT_SECONDS = 140.0 # set by observing the slowest file at commit time was ~100s in CI and adding some leeway
      +#
      +# Set to 300s (5 min) deliberately generous: the per-test subprocess
      +# isolation plugin spawns a fresh Python process per test, so a
      +# large-collection file pays N × (interpreter startup + import) of
      +# overhead before any test logic runs — and that overhead dilates under
      +# load on shared CI runners, producing false "no tests ran" timeouts on
      +# files that finish in ~100s on a quiet box. The Docker build matrix jobs
      +# take 7-10 min anyway, so this headroom costs nothing on total CI wall
      +# time while keeping a genuinely hung file bounded.
      +_DEFAULT_FILE_TIMEOUT_SECONDS = 300.0
       
       # Duration cache: maps relative file paths to last-observed subprocess
       # wall-clock seconds. Used by ``--slice`` to distribute files across

1 PR closed without merging

From the close comments: done elsewhere 1

  • #52334 fix(ci): give CPU-heavy test files a per-file timeout override · done elsewhere → b508d42, #54143
Closed issues · 1
  • Closed#52332CI flake: tests/agent/test_pet_generate.py exceeds the 140s per-file timeout under shard contention (red on main)
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.67: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Subsystem
agent/pet
Merged PRs
#54143
Closed issues
1
Attempts
1 PR closed without merging
Fix link checked
28 Jun 2026

For your agent

The same facts, typed.