alt Hacker NewsCan you tell me more about the cache misses causing a hefty bill? I think I read somewhere that interacting with a CC instance that has been idle for over an hour can cause a cache miss. Is this what you are referring to? How hefty of a bill are we talking? (using Fable for instance)
Iirc the cache hit is 10% of normal input token cost. After the hour you are charged 100% input token cost for the whole conversation.