logoalt Hacker News

adornKeytoday at 9:30 AM2 repliesview on HN

Why? Unlike loads involving a real physical process there is absolutely no need for AI-training to be constant.


Replies

everfrustratedtoday at 9:58 AM

You are correct in the sense that they can stop work in a way many generic server use cases can't (which is seen in lowering power supply reliability requirements as the article mentions), but running expensive servers at 50% utilization would dramatically affect the revenue generated per capital invested - IE you couldn't afford to buy the servers.

show 1 reply
pu_petoday at 9:57 AM

If you invest into chips that deprecate in value really fast, not utilizing them to their full capacity because of power constraints would be counter productive.