logoalt Hacker News

pettijohntoday at 3:47 AM2 repliesview on HN

35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter, so I daily drive that. I wish there was a ~100B MoE with maybe 10B active. It would be super smart and fast!


Replies

mattnewtontoday at 3:50 AM

There was a 3.5 122B 10A release -

https://huggingface.co/Qwen/Qwen3.5-122B-A10B

show 1 reply
nozzlegeartoday at 4:07 AM

I've heard 27B is smarter! I tried it some time ago but couldn't get it working with my oMLX. I need to try it again.

show 2 replies