logoalt Hacker News

stingraycharlestoday at 1:56 PM1 replyview on HN

Sounds like a decision I would make when memory is expensive and you want to get rid of the very long (in time) tail of waiting 1h to evict cache when a session has stopped.

There must be a better way to do this. The consumer option is the pricing difference. If they’d make cache writes the same price as regular writes, that would solve the whole problem. If you really want to push it, use that pricing only for requests where number of cache hits > 0 (to avoid people setting this flag without intent to use it), and you solved the whole issue.


Replies

zozbot234today at 2:00 PM

Memory is expensive? If reads are as rare as they claim you can just stash the KV-cache on spinning disk.

show 1 reply