Does it matter? The frontier models stole the whole internet, then the second-level models stole from them… It’s all theft.
The question is - if the SOTA model disappear - do these follow-on models have the ability to improve themselves without distillation?
Hard agree.
[flagged]
> The frontier models stole the whole internet
What does that even mean?
The question is - if the SOTA model disappear - do these follow-on models have the ability to improve themselves without distillation?