I believe he's saying "Citation Needed" - It does seem the opposite is true, while maybe token cost is going down, frontier models use a lot more, so it's no an accurate gauge of cost. Trying to find any chart of token cost, I found this which looks like inference cost is going up: https://tokenpriceindex.com/ . Of course frontier models are becoming far more useful, but if you're claiming prices are becoming highly profitable then are you saying this increasing price is actually able to cover server costs now? My understanding it was still sold at a loss. And token price increases have turned major companies off the hyper use they tried out early in the year, using it more sparingly. I don't doubt it'll be a solid business, but it's not shaping out to be the hugely scalable business openai promised.