logoalt Hacker News

charcircuittoday at 2:59 AM0 repliesview on HN

Along with everything else. These parameters can make speculative decoding less accurate increasing the inference cost.