logoalt Hacker News

killingtime74 • today at 8:14 PM • 2 replies • view on HN

Your only talking about variable direct energy. Does it take into account the entire lifecycle, building the data centre, running the cooling, building the chips, the % the chips are not utilised.


Replies

epistasis • today at 9:22 PM

> Does it take into account the entire lifecycle, building the data centre

My entire point is that 99% of the dollar cost of running these models goes to things other than the GPU power. The capex cost to building cost to GPU cost to storage/networking/chasses/wiring plus the other operation costs dwarf the electricity. Even the other electricity costs, lets say double it for all the supporting compute, plus another 25% for a 1.25 PUE, and you're at 2.5% of all-in cost of running these models is from electricity.

The non-electricity costs are massive and the constraints on fabs, etc. will drive the amount of the AI build far more than energy availability.

ThibWeb • today at 8:53 PM

No those numbers are GPU only. See https://cleerdash.sustainableaigroup.com/ for a fuller model