Training would fall under "compute and infrastructure investments", which I mention in the 3rd paragraph.

Yes, and the training data behind a lot of models is already stale and rotting fast.

Maintenance is just as important and the cost is often overlooked. The sober reality is that an LLM is just a natural language search index. For now, Google might be the only one with the capability to maintain "training" at the pace most people expect.