Masked test failures incorrectly recorded as passing

Cluster 83116 · agent/verify. Data as of 2026-10-25 11:21 UTC

Nothing open on GitHub. Fix merged in #87506 on 16 Aug 2026. Check it covers your case.

open issues

open PRs

items grouped

Known?: Yes. 4 related items grouped here, 1 issue already closed.
Fix event: A fix was merged to main in PR #87506. Check it covers your case. No release data is tracked.
Tracker: The maintainers' tracker marks this resolved, deciding PR #87506. That is separate from the fix event.
Still open: Nothing open on GitHub.

Next step: read #87506, then check it covers your case.

A bug where masked test failures could be recorded as passing verification, along with related fix attempts addressing this behavior.

Open issues0

No open issues.

No open pull requests.

Merged to main. A stamp counts the issues a fix is linked to.

#87496 fix(terminal): warn when exit_code 0 masks a piped build/test failure

merged to main

files: tests/tools/test_terminal_hints.py, tools/terminal_hints.py, tools/terminal_tool.py
#87506 fix(agent): keep masked test failures from passing verification (salvage #83117)

merged to main

files: agent/verification_evidence.py, tests/agent/test_verification_evidence.py

From the close comments: merged via another change 1

#83117 fix(agent): keep masked test failures from passing verification · merged via another change → c6dfdcb, #87506, #87496

Closed issues · 1

How this cluster was grouped

Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
Pairwise link density 0.50: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

The same facts, typed.