Nice, which model quantization is this? Is it on huggingface?
MTPLX is this software: https://github.com/youssofal/MTPLX
I tried it with the author’s 4-bit quant of Qwen 3.8 27B: https://huggingface.co/Youssofal/Qwen3.8-27B-MTPLX-Optimized... (but no need to download it manually; MTPLX will ask which one you want).
alt Hacker News
MTPLX is this software: https://github.com/youssofal/MTPLX
I tried it with the author’s 4-bit quant of Qwen 3.8 27B: https://huggingface.co/Youssofal/Qwen3.8-27B-MTPLX-Optimized... (but no need to download it manually; MTPLX will ask which one you want).