alt Hacker NewsA “hallucination” is an authoritative counterfactual statement returned as a response. Why do you think it is impossible to engineer an LLM (by which I am including tool usage and RAG) that catches and prevents such statements?
Replies
customguy • today at 1:23 PM
Why do you think that will happen, and why do you think going for slop in the meantime could possibly bring us closer to that?
➕ show 1 reply
Because they are word generators without any concept of quality save what is in their weights and they have been trained on the internet, much of which is wrong or inappropriate for any given context. They have also been trained to be people pleasers and do as they are told.
The popular answer is sometimes the wrong answer.