logoalt Hacker News

BadBadJellyBeanyesterday at 11:00 PM1 replyview on HN

I think the selling point is the 128GB of unified system memory. With that you can run some interesting models. The 5090 maxes out at 32GB. And they cost about $3000 and more at the moment.


Replies

aleccoyesterday at 11:39 PM

1. /r/localllama unanimously doesn't like the Spark for running models

2. and for CUDA dev it's not worth the crazy price when you can dev on a cheap RTX and then rent a GH or GB server for a couple of days if you need to adjust compatibility and scaling.

show 2 replies