logoalt Hacker News

tristortoday at 1:14 PM2 repliesview on HN

I wish they were offering 1TB of Unified Memory for the M5 Ultra. I already have an M5 Max MBP w/ 128GB of RAM for running local models, and while there's a /few/ models that I can run in 512GB that I can't run in 128GB that are interesting, where things really shift is at 1TB of memory which allows you run >1T parameter models w/ 4 bit quants reliably. 512GB is just on the edge of "enough", which is maybe the point of maximum frustration considering current memory prices.

Personally, I can't justify dropping the dosh for a 512GB M5 Ultra, but I would be able to justify it to myself if I could get 1TB of memory, because it'd guarantee the flexibility with local models I currently am missing. Seems a huge miss to not offer this... for a price.


Replies

kamranjontoday at 1:26 PM

1tb would likely be ~$20k - given the current >$10k price tag of 256gb. Would you still be considering it at that price?

show 3 replies
f0cus10today at 1:30 PM

chaining an option?

show 2 replies