alt Hacker Newsdo you have a $100 mil worth of compute to train your own version of this?
I don't understand what gripe people have with open weight models and wanting it to be purely open source. the training dataset is only going to be a copyrighted set of contents you don't want to touch with a 10 feet pole. let alone have a publicly traded company host it for you, even if they internally are training on it.
Replies
a2ff6eeb0 • today at 7:03 PM
It's just about as open source as OSX, which can be downloaded zero cost here: http://updates-http.cdn-apple.com/2019/cert/061-39476-201910...
I love that Apple made OSX open source.
➕ show 1 reply
You don't get why people would like to be in control of a powerful new technology before they build their stuff arround it ?
Sure, there might be currently contraints, but I think it is quite possible training will get optimized over time or crowsourced training can be organized.
Without fully end-to-end open source models you are still at the mercy of the model provider to keep providing updates, you have no idea what garbage they trained the model on & can't fix that, not to mention might end up getting sued for using the open weigth model once all those "AI stole my data" lawsuits are finally decided.