alt Hacker NewsGemini Argon was released a few weeks ago.[1] I'm curious how the development cycle works behind the scenes that allows them to release two models in such short succession. Do they have multiple teams working on different models?
Gemini Argon was released a few weeks ago.[1] I'm curious how the development cycle works behind the scenes that allows them to release two models in such short succession. Do they have multiple teams working on different models?
Likely they did a distillation run on a later checkpoint of a large internal teacher model, probably with some tuning of the distillation process based on early public results with Argon. RL is the expensive/time consuming step, they should be able to distill down from a checkpoint with the stamp of approval pretty quickly.