logoalt Hacker News

Insimwytimyesterday at 4:20 AM1 replyview on HN

  > Model training is similar to the creation of the cgi for the movie. Both happen before anyone consumes the output
I did not say anything about consumption of the output. Maybe you misread what I wrote, it is about energy consumption.

  > Both a movie and a language model can cost
But we weren't comparing cost of the movie to cost of a language model

  > can cost tens or hundreds of dollars
But we weren't talking about dollars, we were talking about energy.

We're clearly exploring different questions.


Replies

sdenton4yesterday at 4:43 AM

And that energy costs money, both at the training/cgi stage and at the inference/consumption stage. It's not even an externality.

CGI renders do use a lot of electricity relative to playing back the movie for individual viewers. It's perfectly analogous.

show 1 reply