FYI, distilling Gemini is explicitly against the ToS:
"You may not use the Services to develop models that compete with the Services (e.g., Gemini API or Google AI Studio). You also may not attempt to reverse engineer, extract or replicate any component of the Services, including the underlying data or models (e.g., parameter weights)."
Thanks, Needle doesn’t compete with those tools though and the distillation process did not access the weights.
FYI, Gemini was developed using stolen copyrighted works without author consent. The double standard is striking.
I think GLM 5.1 or Kimi 2.6 could substitute for this type of purpose.
So is copying all the books in the world.
Oh no! They stole the model weights! Distillation "attacks" is such bullshit
This is being downvoted but it's worth noting if only for the "be careful" aspect.
That said, we need more people distilling models IMO, just be ready for a C&D and a ban
Yeah I think Google should shove that somewhere. They effectively distilled all the internet's knowledge into these models...without asking & without permission