logoalt Hacker News

richard___yesterday at 9:40 PM0 repliesview on HN

Why is self-distillation necessary? Why can't they get the ground-truth for "skipping" steps?