logoalt Hacker News

natrystoday at 4:22 PM1 replyview on HN

I think we don't have a good draft model for better speculative decoding yet (e.g. DFlash 2). Once we do, it will be faster.


Replies

_aavaa_today at 4:39 PM

It very well could be faster, but right now it isn’t.