Will all these data centers really be needed in 5 or 10 years from now?

The technology, compression, etc, for models are getting better and better requiring less and less H/W and power to run the same inference power.

Perhaps our hunger for ever more powerful models will be enough to offset this, but I am not sure.