alt Hacker NewsI do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.
I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.
If there was an affordance on the TUI that made this visible and encouraged users to learn more - that would go a long way.