alt Hacker NewsI was looking into this for LLMs but it's clearly a graphics-processing focused card. The memory bandwidth is too low for that much RAM to be useful in an LLM context. The 5090 I have has the same amount of RAM but far more bandwidth and that makes it much more useful.
Replies
girvo • yesterday at 10:35 PM
Oh wow, I really would've expected higher memory bandwidth. That's only ~2-3x the little DGX Spark-alike I have to play with. Would've expected more.
cmxch • yesterday at 10:26 PM
It’s 32gb for people who can’t go for scalped 5090s but have a 3090 budget.
I have a pair of them with a 9480 and the only thing I have to do is keep the cache happy.
➕ show 2 replies
Compared to a B70, a 5090 is 1x the memory with 3x the bandwidth at 4x the price. Yeah, the 5090 is better, but you're paying for it.