alt Hacker NewsDeadcode is currently working on INT4 right now on his R4D kernel.
The MXFP4 fork is excellent too. Its my daily driver right now. https://codeberg.org/ggz14/radiance-vllm-mxfp4
Also has PARO quant support there too (early stage)
Also speedups in both repos for 4x R9700s
Replies
nicce • today at 3:17 PM
That MXFP4 is an excellent project. But I have difficulties on reading that README. Is it intentionally generated like that with LLMs?
➕ show 1 reply
Thanks! Didn't expect to see this here. Exactly what I needed to run Qwen3.8-27B-Quark-AWQ-MXFP4-native.gguf as well as other experiments on one or 2x R9700's (I hope).