For local LLM people:
(for comparison, M4 pro has 273 GB/s and M1 pro has 200GB/s and M1 max has 400GB/s)
M5 Pro (20-core GPU): 307 GB/s memory bandwidth (supports 24 GB, 48 GB, 64 GB).
M5 Max (32-core GPU): 460 GB/s memory bandwidth. (36 GB)
M5 Max (40-core GPU): 614 GB/s memory bandwidth (supports 48 GB, 64 GB, 128 GB)
These are right at the edge of desirable for me right now -- but it's hard to pull the trigger. I'm imagining an M7 Pro with 480 GB/s and therefore an M7 Max 850-900 GB/s. And significantly better GPU speeds as well. If I knew I could get the M7 Max Q2 of next year, especially at 192GB of RAM, I'd wait.
But then you have to compare to buying a GB200, sticking it in a closet and sharing it out in a workgroup and having a lower specced laptop. Decisions..
Notably these chips came out back in March of this year. Today's changes are in the display and form factor but maintaining the same CPU, GPU, and memory specs.
Rumor is that Apple is skipping the M6 Pro and Max chips this year in favor of releasing the M7 Pro and Max sometime next year.
What's are the odds that the M7 Max goes above 128GB? (Presuming the rumors about Apple skipping the M6 Pro/Max are true)
IMO getting a studio for LLMs is a wiser choice since it doesn't heat up and there are no batteries to degrade.
For an M5 max top bin with 128GB Ram:
- mac studio: $5,899.00 (with 2TB ssd bump to match the default macbook sku)
- macbook 16: $7,399.00
Portability gets a hit but I feel you can have a thin client and let the studio do the heavy lifting back at your home/studio(heh).