It's a bit unrelated, but I've been wondering if LLM providers are using cache read costs to preserve the illusion of constant output token prices. In reality, the longer your context the more expensive output tokens are, but anthropic and openai both have flat output token pricing.

In practice though as a result of cache reads over multiple turns you will end up paying quadratic pricing anyway.