alt Hacker NewsDon't buy the Mini or Studio. Both have the M4 which lacks the Neural Accelerators, making prompt processing ~3-4x slower.
Replies
2Gkashmiri • yesterday at 5:46 AM
Apple Mac Studio (M3 Ultra Chip/28 CPU, 60 GPU/96 GB/1 TB
How is this config?
Don't buy the Mini or Studio. Both have the M4 which lacks the Neural Accelerators, making prompt processing ~3-4x slower.
Apple Mac Studio (M3 Ultra Chip/28 CPU, 60 GPU/96 GB/1 TB
How is this config?
I assume those don't just work automatically with an off-the-shelf gguf. What do you need in your local inference stack to take advantage of M5's neural accelerators?