alt Hacker NewsKinda cool but also entirely useless given the limited VRAM.
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
Kinda cool but also entirely useless given the limited VRAM.
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
A 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.