logoalt Hacker News

WhitneyLandyesterday at 5:19 PM1 replyview on HN

Yeah important conceptually to remember MTP is kind of just more weights, but speculative decoding is the runtime algorithm that’s a significant add to whatever code is serving the model.


Replies

HumanOstrichyesterday at 5:35 PM

That is.. inaccurate.

show 1 reply