Cairn

LiteLLM prompt caching fixes for OpenAI-compatible wire

NousResearch/hermes-agent · cluster 84506 · agent

Data as of

Nothing open on GitHub. Fix merged in #87517. Check it covers your case.

The short answer

0open issues
0open PRs
6items grouped
Known?
Yes. 6 related items grouped here, 1 issue already closed.
Fix event
A fix was merged to main in PR #87517. Check it covers your case. No release data is tracked.
Tracker
The maintainers' tracker marks this resolved, deciding PR #87517. That is separate from the fix event.
Still open
Nothing open on GitHub.

These issues and pull requests address a bug where prompt caching was not engaging for LiteLLM when using the OpenAI-compatible wire protocol, with fixes targeting both Claude and OpenAI-compatible paths.

Open issues0

No open issues.

Open PRs0

No open pull requests.

Fixes on record

Merged to main. A stamp counts the issues a fix is linked to.

  • #87517 fix(caching): engage prompt caching for LiteLLM Claude on the OpenAI wire (envelope layout)

    merged to main

    files: agent/agent_runtime_helpers.py, tests/run_agent/test_anthropic_prompt_cache_policy.py

4 PRs closed without merging

From the close comments: done elsewhere 1 · duplicate 1 · merged via another change 1 · superseded by another PR 1

  • #84544 fix(agent): grant prompt cache for Claude on LiteLLM OpenAI wire · duplicate → #84550
  • #84550 fix(agent): enable prompt caching for LiteLLM OpenAI-compatible wire (#84506) · superseded by another PR → #87039, #84550, #84982, #84506
  • #84982 fix(caching): engage prompt caching for LiteLLM Claude on the OpenAI wire · merged via another change → ff4df5e, #87517
  • #87039 fix(caching): combined LiteLLM OpenAI-wire prompt caching from #84550 and #84982 (#84506) · done elsewhere → #87517, #84982, #77217, #69512
Closed issues · 1
  • Closed#84506[Bug]: Prompt caching never engages for LiteLLM on the OpenAI-compatible wire
How this cluster was grouped
  • Link evidence (structural links throughout): every member is connected by structural evidence: shared changed files, or a closing/superseded reference.
  • Pairwise link density 0.33: the share of item pairs that carry a link, counting a structural link in full and a relevance-only link at 0.36. 1.00 means every pair is linked.

Pick up a Lab task

Check whether a fix covers the open issues here, with your own agent. Bring back evidence for maintainers.

Open the Lab

At a glance

Subsystem
agent
Merged PRs
#87517
Closed issues
1
Attempts
4 PRs closed without merging
Fix link checked
16 Aug 2026

For your agent

The same facts, typed.

cluster/84506.json
cluster/84506.md