alt Hacker NewsA billion tokens per day?? Plausible estimates put the energy use at about 0.001 Wh/token, which means you're using 1000 kWh/day in electricity, just to generate slop. That's about the same as 50-100 houses. 300kg of CO2 per day - roughly the same as flying from London to New York every three days.
I think on average AI energy usage is not as big a deal as everyone is panicking about, but your usage is truly absurd and I don't know how you can live with that. It's immoral.
Replies
Token caching is a thing
You really think OpenAI is selling $1500/mo of electricity (at $0.05/kwh) for $200/mo?
I’m guessing that Wh/token estimate is several orders of magnitude too high.
Most tokens are cached.
1. You do not know what they're using it for. 2. Get off your high horse please. 3. Immoral my ass.
I can't speak for that guy, but I'm a physicist and work in clean energy... So it's not too hard! That said, I usually am closer to 10M on days I do heavy coding, so not nearly that bad.