alt Hacker News> the world really has moved on to open models
Don't get me wrong: I'm all for open models, but I think it will get more and more difficult to distil-train them without (legitimate) access to frontier models.
Replies
As if all progress done in open models is because of distilling...
People have no idea and everybody pretends to be an expert and ignore how good China is on AI research
Personally, I find it rather humorous that we've moved from the fear that AI generated output would corrupt training to the idea that it is essential to training. Reality itself has not just a left bias but a bias to fundamentals. Bootstrap from fundamentals without introducing arbitrary error and you have the superior system; it just may not be highly compatible with a trash ecosystem.
I’m not sure, because the same thing happened with facebook advertising restrictions during the 2018 elections and nowadays there’s a whole black market for fake ad accounts.
If anything I bet these people will just use their knowledge to make even more money reselling tokens.