> A bigger dense model beats it. Qwen3.8 27B ...
How is a 27B dense model bigger than a 78B MoE?
The 27B has all 27B as active parameters, while Kolibri is only 3.46B active parameters. I think that's what they meant anyway.
alt Hacker News
The 27B has all 27B as active parameters, while Kolibri is only 3.46B active parameters. I think that's what they meant anyway.