logoalt Hacker News

liuliuyesterday at 8:44 PM0 repliesview on HN

> training an LLM takes more resources and expertise than distilling from an existing LLM

This is not automatically true. Training and distillation use the same underlying infra and method and there is no intrinsic differences in between.