logoalt Hacker News

rpdillon • today at 3:10 PM • 0 replies • view on HN

Deepseek v4 flash 0731 in a 2-bit quant has been useful for me. Other models don't seem to hold up nearly as well at 2-bit. Most of my other models are 5-6 bit quants because of this.