logoalt Hacker News

naveen99 • today at 12:14 PM • 1 reply • view on HN

Isn’t that distillation ?

Replies

mrfox321 • today at 12:28 PM

No. Distillation trains on a teach model's logits or output tokens.