logoalt Hacker News

xreborn • today at 3:22 PM • 0 replies • view on HN

from my experience dense models like 27b suffer less from quantization compared to large MoEs