logoalt Hacker News

m00xtoday at 4:13 PM0 repliesview on HN

This is where MoEs shine though. You don't need all experts in memory at once. Diffusion inference doesn't have sparse inference.