logoalt Hacker News

a2ff6eeb0today at 6:50 PM2 repliesview on HN

> The more open source software out there the better.

Can you explain how I'd train my own version of this, reproducing the final deliverable that runs on the gpu?


Replies

subygantoday at 6:56 PM

do you have a $100 mil worth of compute to train your own version of this?

I don't understand what gripe people have with open weight models and wanting it to be purely open source. the training dataset is only going to be a copyrighted set of contents you don't want to touch with a 10 feet pole. let alone have a publicly traded company host it for you, even if they internally are training on it.

show 2 replies
alfalfasprouttoday at 6:52 PM

The weights are open, the training data obviously isn't. But a key thing you can do with open models is fine tune them. So while they may not be SOTA at everything, they can become SOTA at your particular business use case.