alt Hacker News> One datacenter rack of NVIDIA Vera Rubin GPUs costs $8 million. That's about the same cost as a team of software engineers.
How many engineers do you think that can pay for? At 100k/year that's a pretty huge team.
Replies
tristanj • today at 1:17 PM
A large team at Meta (16 people) would cost the company more than $8m/year. That is all-in cost, including payroll taxes, benefits, etc.
Where are you finding engineers at 100K/yr all-in? Also how many of them will be as good at coding as the models you deploy on the rack?
Also you need both now. It’s not enough to just have humans, and that OpEx needs to come from somewhere.
I’m not happy about it - just the way it is.