alt Hacker NewsThat argument is moot as distillation also requires a lot of hardware and software, if copying models was as easy as that, we would have hundreds of competing models.
That argument is moot as distillation also requires a lot of hardware and software, if copying models was as easy as that, we would have hundreds of competing models.
No. Building models and distilling models both require the hardware and software. It doesn't mean building models is distillation.