alt Hacker NewsCorrect. We need open weights, open code and open data. If nobody else can reproduce what someone did there will always be security questions. Even if we can reproduce it there could still be security concerns but it's more realistic to investigate yourself.
Replies
essentia0 • yesterday at 11:06 PM
Exactly what are the possible 'security issues' of self hosting an open weights model?
➕ show 2 replies
urams • today at 2:07 AM
> We need open weights, open code and open data.
Even with this, the cost of verification would be enormous. You would need a massive cluster to repeat the training E2E.
I'm all for open models, but people seem to misunderstand what they are. They aren't the same thing as open source code!
> open weights, open code and open data
Even if you have all these things you still can't replicate a model because of randomness.
You can backdoor a model with less than 1000 examples and it is impossible to detect.