logoalt Hacker News

senectus1today at 1:18 AM3 repliesview on HN

wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies


Replies

wmftoday at 1:28 AM

Two RTX 6000 have more FLOPS and more memory bandwidth than a M5 Ultra (but they also cost more).

rubyn00bietoday at 3:50 AM

There’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory).

If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.

bigyabaitoday at 1:46 AM

If your goal is pure GPU compute, you should have got a 5090. It can bench comparable to the RTX 6000 Pro cards and is near guaranteed to outperform M5 Ultra.