logoalt Hacker News

skirmishyesterday at 10:31 PM0 repliesview on HN

Don't think so because all tokens predicted speculatively are still validated against the main model (which is faster than predicting them from scratch) and only accepted if they match exactly.