logoalt Hacker News

secondcominglast Saturday at 11:21 PM4 repliesview on HN

How can we be sure that LLMs won't start giving stale answers?


Replies

mark-rlast Saturday at 11:27 PM

We can't. I don't think the LLMs themselves can recognize when an answer is stale. They could if contradicting data was available, but their very existence suppresses the contradictory data.

show 1 reply
g947olast Saturday at 11:47 PM

They will, but model updates and competition help solve the problem. If people find that Claude consistently gives better/more relevant answers over GPT, for example, people will choose the better model.

The worst thing with Q/A sites isn't they don't work. It's that they there are no alternatives to stackoverflow. Some of the most upvoted answers on stackoverflow prove that it can work well in many cases, but too bad most other times it doesn't.

Someone1234last Saturday at 11:28 PM

They still use the official documentation/examples, public Github Repos, and your own code which are all more likely to be evergreen. SO was definitely a massive training advantage before LLMs matured though.

Cloudeflast Sunday at 12:36 AM

LLMs are just statistics, eventually they kill themselves with feedback loop by consuming their own farts (literally)