logoalt Hacker News

jnovekyesterday at 5:54 PM0 repliesview on HN

I’m so confused in these comments right now — I thought you had to load an entire MoE model and sparseness just made it so you can traverse the model more quickly.