logoalt Hacker News

sarchertechtoday at 4:16 AM1 replyview on HN

Caching has so many caveats. The cache expiration window is short, if you change document in the context it clears the cache, if you change anything in the prompt prefix it clears the cache. And there’s no reason to think that Anthropic will keep charging dramatically less for cached tokens on the future once they start trying to make a profit.


Replies

shepherdjerredtoday at 4:53 AM

My understanding is that Claude Code/Codex both put great effort into utilizing caching.