I don't think any models are natively INT4? I wouldn't see the point to nerf the model out-of-the-box.
It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.
alt Hacker News
It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.