I think even if the moat dries up, you could think of tokens/inference similar to compute. There's all the open source tooling available in the world for you to rent your own bare metal servers/racks and use a white glove service, yet there is demand for cloud.

At current prices, it makes sense to self host, but if the price goes down and the demand grows across different verticals, there is room for this business.