logoalt Hacker News

CamperBob2today at 6:03 AM1 replyview on HN

So, realistically, $100K for an 8x RTX 6000 Pro system that can run it at a usable rate.


Replies

zozbot234today at 6:12 AM

I think people will always disagree on what qualifies as a "usable rate". But keep in mind that practically no one sensible is running the latest Opus or GPT around the clock, especially not at sustainable, unsubsidized prices. With open-weights models it's easy to do that.

show 1 reply