Equating this buildout with LLMs is also a category error. Waymo (self-driving cars) depends on the same infrastructure, and there are a variety of other robotics programs which are actually functioning, you can see them in operation. They all require a lot of GPUs to train and run the models which operate the robotics.
It's not clear that Waymo is an improvement over existing infrastructure so much as ensuring that fewer humans benefit from each car ride (which was already pathetically low).
What % of GPUs are running self driving software or robotics?
And what is the ROI on either of those right now?
Is Waymo a good example when Google has third world people sitting at a screen operating the vehicle on the other side of the world, how can it performance be trusted?