alt Hacker NewsFWIW scaling up from https://huggingface.co/avlp12/Qwen3.8-27B-Alis-MLX-6bit and some other sources:
You might expect the M5 Ultra to produce 50 t/s from Qwen 3.8 27B with a good context length.
FWIW scaling up from https://huggingface.co/avlp12/Qwen3.8-27B-Alis-MLX-6bit and some other sources:
You might expect the M5 Ultra to produce 50 t/s from Qwen 3.8 27B with a good context length.