alt Hacker NewsOne of the interesting slights of hand Apple marketing must do is simultaneously say the new processor is awesome while selling the higher spec versions of the previous processor as upgrades:
The M6 chip joins M5 Pro and M5 Max to create our most advanced line-up of chips ever built for a pro laptop. With a 12-core CPU, 12-core GPU and our first ever Dual 16‑core Neural Engine, M6 brings next-generation speed and advanced on device AI. All three chips deliver phenomenal single- and multithreaded CPU performance and faster unified memory. . . .Replies
tines • yesterday at 5:12 PM
sleight*
My 5090 has a bandwidth of 1,792 GB/s, and that is just about good enough for basic (i.e. 27B models) local LLM inference.
The fastest M6 MacBook Pro (24/32GB configs) has a memory bandwidth of 170 GB/s. And the M5 Max is 614 GB/s.
Am I missing some nuance of the M6 MBP here, or am I right to assume it won't set the local LLM world on fire?