logoalt Hacker News

foota • yesterday at 7:37 PM • 0 replies • view on HN

My theory here is that providers cover the non-constant costs of output tokens as context length caries using the cache input fees.