Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.
For sure and growth also costs money for buying DCs etc.
They are constantly training and getting rid of older models, they are losing money
For sure and growth also costs money for buying DCs etc.