I'm confused, the unsloth model is ~600mb and the one from google is 7gb? | alt Hacker News

alt Hacker News

slopinthebag • today at 5:56 PM • 1 reply • view on HN

I'm confused, the unsloth model is ~600mb and the one from google is 7gb?

Replies

overfeed • today at 7:30 PM

One is quantized, the other one is Quantization-ready.