logoalt Hacker News

dansotoday at 2:15 AM1 replyview on HN

Genuine question: is the cost to keep a persistent warmed cache for sessions idling for hours/days not significant when done for hundreds of thousands of users? Wouldn’t it pose a resource constraint on Anthropic at some point?


Replies

johnsonbuildstoday at 3:10 AM

[dead]