logoalt Hacker News

adrian17 • today at 1:02 PM • 0 replies • view on HN

I’m confused too and the slop readme doesn’t help at all.

> Shrinks DeepSeek-V4-Flash from 76.87 GiB (which crashes in OOM on 64 GB Linux) down to 56.56 GiB

And later

> Standard IQ2_XXS (76.87 GiB, Unpatched)

Except unsloth’s IQ2_XXS GGUF is 91GB, even their smallest IQ1_S is 82.5GB. So I wonder which model/quant the number even refers to.

Also the mentions of “compression” and “MoE pruning” also make it sound lobotomized even more than unsloth’s IQ1 quants.