I'm all for open models, but people seem to misunderstand what they are. They aren't the same thing as open source code!
> open weights, open code and open data
Even if you have all these things you still can't replicate a model because of randomness.
You can backdoor a model with less than 1000 examples and it is impossible to detect.
You don't want to replicate the exact model, you want to build a system of similar capabilities.
Yeah - we also don't know if the models from OpenAI and anthropic are back-doored either.