alt Hacker NewsLooks like it's Qwen3.5-397B-A17B so 17B active. https://github.com/Anemll/flash-moe/tree/iOS-App
Replies
Hasslequest • yesterday at 5:59 PM
Still pretty good considering 17B is what one would run on a 16GB laptop at Q6 with reasonable headroom
Looks like it's Qwen3.5-397B-A17B so 17B active. https://github.com/Anemll/flash-moe/tree/iOS-App
Still pretty good considering 17B is what one would run on a 16GB laptop at Q6 with reasonable headroom
Stupid question: can i run this on my 64GB/1TB mac somehow easily? Or this requires custom coding? 4bit is ~200GB
EDIT: found this in the replies: https://github.com/Anemll/flash-moe/tree/iOS-App