logoalt Hacker News

jgeralniktoday at 5:51 AM0 repliesview on HN

Ah, fair enough. Anthropic caches at a block level (basically a single message) so for non-trivial messages this is really less of a concern, although I definitely understand why they still scope cache to a single tenant