logoalt Hacker News

utilize1808 • today at 9:06 PM • 3 replies • view on HN

I don't understand why "Cache warming for anthropic models" was not put into a standalone package, but has to be bundled with the "minimal" coding agent.


Replies

tcdent • today at 11:11 PM

Yeah, it's such a subjective feature. I don't really worry about the five minute timeout, but sometimes if I'm conscious about the fact that I have an 800k token context window that I haven't interacted with for a day, I will switch to Opus for compaction and then back to Fable for interaction.

In general, though, some kind of API ping on a timeout does not support my personal workflow, which involves dozens of active or stagnant agent sessions that stay open for weeks.

ruined • today at 10:26 PM

because "i came back from lunch and my fresh 5h usage limit evaporated" is not a feature

i guess you could blame the api, if you wanted.

➕ show 1 reply
threecheese • today at 10:11 PM

It's table stakes for using Anthropic APIs cost-consciously. They aren't building a minimal harness for nerd points; they are building it to be usable, and dogfooding it with Real Money to learn what that means realistically.

This might've made a better argument ca. 2005 wrt a 20-something Austrian's minimalist wsgi framework. Heck, I'll bet you could even find said argument somewhere in the Archive :)