logoalt Hacker News

sva_today at 6:21 PM1 replyview on HN

In 95% of cases it is because you had a large context for which the cache expired.


Replies

bearjawstoday at 6:37 PM

The amount of people I see running around at 800k context and wondering why they are burning through tokens is always surprising.