logoalt Hacker News

throwaway314155yesterday at 10:36 PM1 replyview on HN

> which creates a situation where Gemini 2.0 was used in a way to train Gemini 2.5.

The use of synthetic data from prior models to create both superior models and distilled models has been going on since at least OpenAI's introduction of RLHF, and probably before that too.


Replies

happyopossumtoday at 5:28 AM

> The use of synthetic data from prior models

That’s distinct from those prior models providing actual code to improve the next model