# NousResearch/hermes-agent · Agent verification guards against unverified tool claims

## Open now

- 6 issues, 2 PRs open on GitHub.
- #28056: Add in-run quality gates with bounded retry for cron/agent runs
- #45577: CLI/runtime: block unsupported 'STATUS: DONE / verified / deployed' summaries after non-executing tool turns
- #48214: LLM overconfidence on factual assertions — agent answers from memory instead of verifying system state
- #53072: Agent may claim GitHub repo creation/push succeeded after tool failures without verification
- #54722: Agent can report verified success or factual conclusions after failed or unverified tool evidence
- #58196: \[Feature\]: Verification enforcement -- verify-before-claim guidance + unsupported-completion-claim detector
- PR #53388: fix(agent): flag unverified external state after tool failures
- PR #54738: fix(agent): add generic tool-verifier footer for unverified tool failures

These items address a pattern where the agent asserts success or factual conclusions after tool failures or without verifying external state. The work spans detection, prompting guidance, runtime guards, and quality gates to prevent unsupported completion claims.

## TL;DR

- 10 member(s): 6 open issue(s), 0 closed issue(s), 2 open PR(s), 1 merged PR(s), 1 PR(s) closed without merging.
- A fix was merged to main in PR #50009. Verify it addresses your case.
- **Recommended:** read PR #50009 (and any competing PRs below) before filing. Confirm the merged change covers your symptom.

## Maintainer resolution verdict

- Internal-tracker verdict over this cluster's issue members: `unresolved`. This is distinct from the fix status above. Weigh it yourself.

## How this cluster was grouped

- Link evidence (`STRUCTURAL_PARTIAL`): some members are connected by structural evidence (shared changed files, or a closing/superseded reference); the rest are joined by an automated relevance judgement over their text.
- Members outside that structural core may belong to a different underlying problem.
- Pairwise link density `0.13`: the share of member pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. `1.00` means every pair is linked.

## Open related issues

- #28056: Add in-run quality gates with bounded retry for cron/agent runs
- #45577: CLI/runtime: block unsupported 'STATUS: DONE / verified / deployed' summaries after non-executing tool turns
- #48214: LLM overconfidence on factual assertions — agent answers from memory instead of verifying system state
- #53072: Agent may claim GitHub repo creation/push succeeded after tool failures without verification
- #54722: Agent can report verified success or factual conclusions after failed or unverified tool evidence
- #58196: \[Feature\]: Verification enforcement -- verify-before-claim guidance + unsupported-completion-claim detector

## Prior & competing PRs

- **#50009: fix(agent): guard finalize_turn cleanup chain so it never drops the response**. merged to main · fix tier `verified`
  - maintainer direction: category `merged`; implication `superseded`
  - files: `agent/turn_finalizer.py`, `tests/agent/test_turn_finalizer_cleanup_guard.py`
- **#45629: fix(agent): guard unsupported completion claims**. closed without merge
  - maintainer direction: category `volume_quota`; implication `active`
- **#53388: fix(agent): flag unverified external state after tool failures**. open
  - maintainer direction: category `implemented_elsewhere`; implication `superseded`; refs `953ee63382a9ae3cede6f05104a864a604f61506`
  - files: `agent/tool_executor.py`, `agent/turn_context.py`, `agent/turn_finalizer.py`, `run_agent.py`, `tests/agent/test_turn_finalizer_cleanup_guard.py`, `tests/run_agent/test_file_mutation_verifier.py`, `tests/run_agent/test_tool_call_guardrail_runtime.py`
- **#54738: fix(agent): add generic tool-verifier footer for unverified tool failures**. open
  - maintainer direction: category `superseded_by_pr`; implication `superseded`
  - files: `agent/tool_executor.py`, `agent/tool_guardrails.py`, `agent/turn_context.py`, `agent/turn_finalizer.py`, `run_agent.py`, `tests/run_agent/test_tool_failure_verifier.py`

## Fix status

- Merged to main in PR #50009 (cited above). No release data is tracked. Verify downstream.
- Fix last verified (merged) `2026-06-21`.
- Subsystem: `agent`