alt Hacker NewsI don't know if that's really true. Given realistic life cycles of equipment (~10 years, not 3 as commonly believed) the operating power is going to be 75-80% of the TCO, or more.
I don't know if that's really true. Given realistic life cycles of equipment (~10 years, not 3 as commonly believed) the operating power is going to be 75-80% of the TCO, or more.
I don't see how that number could possibly be realistic.
A H100 cost 30k when new, and uses 500W of power.
500W for a year is about 4500kWh, which at $0.10/kWh is $450/year if run at full utilization (unrealistic).
TCO of an AI data center should be entirely dominated by capex depreciation.