alt Hacker NewsIf Anthropic is calling it distillation [1] then that would argue for it being correct (or at least canonical) terminology.
[1] https://www.anthropic.com/news/detecting-and-preventing-dist...
If Anthropic is calling it distillation [1] then that would argue for it being correct (or at least canonical) terminology.
[1] https://www.anthropic.com/news/detecting-and-preventing-dist...
No, a company choosing to use some terminology doesn’t make it correct nor canonical in any sense; especially when they have a vested interest in not being neutral or credible.
If Google starts calling ads “Best Links” that doesn’t make it correct nor canonical; the correct term is still ads.
Traditionally, distillation is when you get the actual logits of a model response (not exposed via API for years) and then use that to train a model.