alt Hacker NewsHas any individual/SMB purchased this yet? Aware the ROI isn't there for most individuals that don't heavily use LLM for coding or multi agentic workflows -- but for those that it does make sense this is ~$68k cheaper than the next alternative making this the most realistic option for consumer grade access to frontier models.
Specifically interested if anyone has ran GLM-5.3 (753B MoE) in 4-bit on a 512GB Mac Studio. Looking for real world usage numbers and/or any benchmarks you might have performed.
Thanks!
Replies
bigyabai • yesterday at 5:58 PM
GLM-5.3 would be bottlenecked by the M5's GPU, here. I don't have any hard numbers, but Apple Silicon is known for weak prefill performance on larger models (yes, even MoEs).
➕ show 2 replies
They haven't shipped yet (people who purchased the moment it became available have delivery dates near the end of the month). That said you can estimate it's speed by looking at the 256GB version for models with similar numbers of active parameters (GLM 5.3 has 40B active parameters). So for 4-bit you could compare to what people are getting Qwen3.8 27B at 8-bit (which is around 2000 tok/s prefill and 70-80tok/s token generation [1]). It might be a little higher or a little lower due to the different architecture and kernel optimizations.
[1]: https://omlx.ai/benchmarks/performance?model=qwen3.8+27b&chi...