alt Hacker NewsThat doesn’t make sense to pay more for cache warming. Your session for the most part is already persisted. Why would it be reasonable to pay again to continue where you left off at any time in the future?
Replies
danso • today at 2:15 AM
Genuine question: is the cost to keep a persistent warmed cache for sessions idling for hours/days not significant when done for hundreds of thousands of users? Wouldn’t it pose a resource constraint on Anthropic at some point?
➕ show 1 reply
cadamsdotcom • today at 12:43 AM
Sure, it wouldn’t make sense if they only had one customer to serve :)
Because it significantly increases actual costs for Anthropic.
If they ignored this then all users who don’t do this much would have to subsidize the people who do.