Cost per token is going to tank; it's a race to the bottom. The frontier model providers have no moat between each other and eventually even the open weight models will be "good enough" for almost every purpose.
Right now the market is expecting something a lot more than "sells a lot of tokens" out of these things to justify their valuation.
personally thats why i think OAI is in a way better place with them targeting ads.
The future is in private data, private models, and private APIs, which can't be distilled as easily as public APIs.