Often people are counting all tokens, including cached input tokens, for those more impressive "billions of tokens" quotes.
Ah, thanks, I'd missed that nuance in the other reply!
alt Hacker News
Ah, thanks, I'd missed that nuance in the other reply!