> It's reasonably safe bet that there will always be someone on the planet with the means and interest to commodify the models. They don't seem very hard to make; we're swimming in options.

I don't think that is a safe bet; right now we're all benefitting from investors who disagree about who is going to win a monopoly, with each AI stock priced as if it will be the winner and the market collectively therefore priced several times higher than the maximum* return.

When the investment bubble pops, I think there will be too many burned fingers to keep training new models. If we're lucky though, it may lead to someone burning weights onto hardware, which has the potential to significantly reduce the energy required per token.

* currently possible return at least. I don't think any of the investors are actually pricing for the possibility of an actual technological singularity. Even Musk's rhetoric about this, where he opines about getting humanity to Kardashev type II, the numbers he attaches to this are orders of magnitude too small.