alt Hacker NewsTotally agree that it's just a proxy for people's feelings on AI, but my Lobster Jesus is much more important to me than a Netflix show! All of the datacenter usage (for inference) is just serving something people want. Time has already shown that the datacenter for training is also just creating something people want.
Replies
K0balt • today at 6:44 PM
Lobster Jesus FTW.
> All of the datacenter usage (for inference) is just serving something people want.
I agree with this in principle, but I wonder how asymmetric the usage is. When I hear about developers dropping $200/mo (subsidized!) on AI coding, and having multiple agents on supergigaultramax effort churning on stuff for hours... Versus your average person maybe asking a few chatgpt questions every day or week... IDK.
Like others have said, yes, OpenAI probably isn't literally going to sell you more than $200 of electricity for $200/mo. But data centers get industrial rates, and $200 of power is still a decent bit of power just to be churning out slop! (It's about a monthly home bill and EV charging cost combined) And some companies spend way more than that on API pricing for tokens... It's just hard to get a handle on where the usage is actually going.
I just wish we could pass a common sense law to require them all to build renewables. It's literally electricity, it's the easiest energy to decarbonize.