alt Hacker NewsIs it weird to anyone else that the M5 keeps the same limitations of the M4, and tops out at 128 GB of RAM?
If one wants to serve large-ish LLMs locally, an M3 Mac Studio w/ 512 GB/RAM is still a super compelling option, and I was hoping that the M5's would bump us up to 1TB of unified memory.
Don't get me wrong -- seeing them use LMStudio as the benchmark for measuring local LLM inference is super awesome for the local / open-source LLM community, but seeing this have the same 128GB cap as the M4 is... disappointing?
M3 Studio is still the best option if one wants 512GB.
Replies
cco • today at 6:43 PM
I tremble to think at the cost of 1TB of ram in an apple laptop.
Apple hasn't suddenly stopped being Apple. They strongly differentiate the boundaries of their product lines and have never let use case leakage spread across their product lines.