> Data sharing agreements permitting, today's inference runs can be tomorrow's training data. Presumably the models are good enough at labeling promising chains of thought already.
Wouldn't this lead to model collapse?
Not necessarily, as exhibited by the massive success of artificial data.
Not necessarily, as exhibited by the massive success of artificial data.