logoalt Hacker News

ACCount37yesterday at 3:36 PM2 repliesview on HN

Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.


Replies

Glemllksdfyesterday at 3:59 PM

For sure and growth also costs money for buying DCs etc.

howdareme9yesterday at 3:46 PM

They are constantly training and getting rid of older models, they are losing money

show 1 reply