alt Hacker News>For all their flaws, LLMs are so much better
But LLMs get their answers from StackOverflow and similar places being used as the source material. As those start getting outdated because of lack of activity, LLMs won't have the source material to answer questions properly.
Replies
badthingfactory • last Saturday at 11:34 PM
StackOverflow answers are outdated. Every time I end up on that site these days, I find myself reading answers from 12 years ago that are no longer relevant.
➕ show 1 reply
terminalshort • last Saturday at 11:43 PM
Now they can read the documentation and code in the repo directly and answer based on that.
➕ show 1 reply
nutjob2 • last Saturday at 11:51 PM
I think the industry is quickly moving to syntheticly derived knowledge, or custom/systematic knowledge production from humans.
I regularly use Claude and friends where I ask it to use the web to look at specific GitHub repos or documentation to ask about current versions of things. The “LLMs just get their info from stack overflow” trope from the GPT-3 days is long dead - they’re pretty good at getting info that is very up to date by using tools to access the web. In some cases I just upload bits and pieces from a library along with my question if it’s particularly obscure or something home grown, and they do quite well with that too. Yes, they do get it wrong sometimes - just like stack overflow did too.