The moat is in the compute and the energy access.
And further down the line in chips, which is why Elon is building a fab now.
There are plenty of capable models on HuggingFace, yet I have no way of running them.
That fab will never be delivered. In five years you might see the manufacturing equivalent of a person dancing in spandex.
> which is why Elon is building a fab now
At least he says he's doing that. It doesn't really make sense since you're not going to achieve an advanced node from a standing start in a practical time frame and cost.
Sounds like more Musk flavored vapor.
Give it a few years, or month. Tiny models are getting outrageously good