alt Hacker NewsYeah, nobody is doubting that people want to consume tokens. We're doubting that that Google, OpenAI, or Anthropic has a significant enough moat to keep people buying their tokens there. Over the past couple years the moat has been the model. As open models are getting better, that moat is drying up. Eventually the market for "tokens" will converge with the market for compute, which is a commodity with little to no moat.
I think even if the moat dries up, you could think of tokens/inference similar to compute. There's all the open source tooling available in the world for you to rent your own bare metal servers/racks and use a white glove service, yet there is demand for cloud.
At current prices, it makes sense to self host, but if the price goes down and the demand grows across different verticals, there is room for this business.