logoalt Hacker News

Tade0 • yesterday at 7:33 PM • 0 replies • view on HN

To add to the other comment, there's also Ridge quantisation - the majority of weights are indeed Q3_x, but the most sensitive layers are FP8.