Add 'last two messages' cache breakpoint strategy for Messages API (#312472)
* Add 'last two messages' cache breakpoint strategy for Messages API Adds an experiment-gated alternative to the heuristic-based cache breakpoint placement. Places cache_control on the last two merged Anthropic messages instead of using prompt-tsx markers and addCacheBreakpoints. Gated behind AnthropicCacheBreakpointsLastTwoMessages (default false, onExp). * Address PR review: handle pre-marked tail messages in addLastTwoMessagesCacheControl * Remove 'advanced' tag from cacheBreakpoints.lastTwoMessages setting
B
Bhavya U committed
d603ad485d534b9debd2c27a3b6268c80bffee0d
Parent: 40cc75e
Committed by GitHub <noreply@github.com>
on 4/26/2026, 4:57:52 PM