alt Hacker News> Cloud models […] don't consume so much power/generate heat
I do realize the cloud is just someone else’s computer right? Power goes in, tokens and heat come out - just in another place
> Cloud models […] don't consume so much power/generate heat
I do realize the cloud is just someone else’s computer right? Power goes in, tokens and heat come out - just in another place
The cloud computers produce more tokens per watt. That said, if you have a computer at home running 24/7 for other reasons and you also can use it for some LLM work, why not.