alt Hacker NewsA 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.
A 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.