logoalt Hacker News

grueztoday at 1:24 PM1 replyview on HN

>Opus 4.6 Max self-hosted at 30 tok/s on a 5k Macbook in Aug 2026. The LLM timelines are crazy.

How much memory does this translate to and what quantization (if any) were applied?


Replies

rohansood15today at 1:35 PM

128GB, 4-bit quantized.