logoalt Hacker News

flexagoontoday at 11:50 AM3 repliesview on HN

The huge energy waste is from model training, not inference


Replies

killerstormtoday at 12:20 PM

A continuously running agent might require 100-500W for inference, so comparable to gaming or a small space heater. Not obscene, but also not negligible.

If we assume 250W for a continuously running agent, Grok 4 training run estimate would be around 50 million session-days, so a half-million people might consume as much running agents continuously for 100 days.

show 1 reply
xbmcusertoday at 12:06 PM

if that was true tokens would be free

jstummbilligtoday at 12:03 PM

"waste"

All of a sudden we are selectively squeamish with computer resource usage, when we were fine having all that fun with computers and hardware, 3 monitor setups, using graphic cards to play games (dear lord!) and tinkering around with home rigs of every proportion and wattage for no reason at all.

show 2 replies