logoalt Hacker News

zackangelo • yesterday at 5:56 PM • 1 reply • view on HN

Isn't Kimi K2.6 natively INT4?

Replies

simjnd • yesterday at 6:27 PM

I don't think any models are natively INT4? I wouldn't see the point to nerf the model out-of-the-box.

➕ show 1 reply