alt Hacker NewsThere is a reason why LLMs can not be good at this: They don't know what they are quoting or citing. A different kind of model with factoid provenance could do it?
Replies
They can. I had one doing original OCR of a scanned piece yesterday. It found relevant page numbers and understood the context. It read the whole book to find the relevant cites. Even went though the genealogy table and found ground breaking references no one noticed before. Total cost under 5 dollars and time was less than 20 mins.
The hallucination era is rapidly ending.
People reading a source can't know if it's true just by reading it either (though they could be fairly sure if it's false sometimes)
Sure they can, as long as they can access online resources they can give you an exact list of sources they're using in their responses.
>They don't know what they are quoting or citing.
What do you mean by this? I have passed very large documents into LLMs and they are able to accurately extract quotes and identify their location in the source documents. I don’t see any reason to think that they couldn’t accurately quote from and cite existing literature.