alt Hacker NewsAverage user input quality is not optimal by definition. SO's upvote system and reputation system is what really refined quality. Much like Reddit's system is helping a lot for conversation. Much like academia's publish and citation system is an even better system.
I'm not saying LLM won't be able to train further, but tough and sound reviews are paramount to improving the corpus of quality content. And with the replacement of SO by LLMs, one can wonder if one quality system went down the drain. Anyway there's still code reviews on GitHub and in private repos, but we're still far from getting the human judgement out of the loop.
Replies
I do expect there will be more closed knowledge forums. Unfortunately one person exposing it to LLM provider will be enough to break the whole idea. But I believe there will be many that will keep secrets for some in group.
"Average user input quality is not optimal by definition."
Absolutely.
"SO's upvote system and reputation system is what really refined quality."
Absolutely not!
SO's problem was exactly that they gave average users moderating power. That lead to half of the questions being closed because they were over the head of the average user/moderator regardless of being interesting and useful questions or not.