logoalt Hacker News

CamperBob2yesterday at 10:00 PM1 replyview on HN

You could run the full, unquantized model at high speed with 8 RTX 6000 Blackwell boards.

I don't see a way to put together a decent system of that scale for less than $100K, given RAM and SSD prices. A system with 4x H200s would cost more like $200K.


Replies

ttultoday at 5:31 AM

That would be quite the space heater, too!