alt Hacker NewsIt’s 400B but it’s mixture of experts so how many are active at any time?
Replies
anshumankmr • today at 4:24 PM
Aren't most companies doing MoE at this point?
It’s 400B but it’s mixture of experts so how many are active at any time?
Aren't most companies doing MoE at this point?
Looks like it's Qwen3.5-397B-A17B so 17B active. https://github.com/Anemll/flash-moe/tree/iOS-App