logoalt Hacker News

AYBABTMEtoday at 6:35 AM2 repliesview on HN

This right now today is making the case for OSS AI and local inference. 200$/m to get rate limited makes a RTX 6000 Pro look cheap.


Replies

tmountaintoday at 6:46 AM

How well do local OSS models stack up to Claude?

show 3 replies
re-thctoday at 8:19 AM

What’s the depreciation on that RTX 6000 though?

New hardware keeps on coming with large gains in performance.

show 1 reply