logoalt Hacker News

bcyeyesterday at 11:13 PM3 repliesview on HN

Reminder that LLMs only(?) consume energy on the order of a few seconds of Netflix[1].

[1]: https://bsky.app/profile/simonwillison.net/post/3m6qdf5rffs2...


Replies

belvalyesterday at 11:23 PM

Netflix spending 240Wh for 1h of content just does not pass the smell test for me.

Today I can have ~8 people streaming from my Jellyfin instance which is a server that consumes about 35W, measured at the wall. That's ~5Wh per hour of content from me not even trying.

show 3 replies
oytisyesterday at 11:31 PM

That's inference only, otherwise people would not be buulding nuclear reactors to power AI.

show 1 reply
add-sub-mul-divyesterday at 11:47 PM

It's quickly pointed out that he's not counting the training of models, producing all the GPUs, energy spent on scraping, the increased storage needs from scraping the whole internet, etc.

show 1 reply