logoalt Hacker News

daishi55yesterday at 10:53 PM2 repliesview on HN

Not really. Take hallucinations for example. If they are 1 in 100 (actually they are much rarer, but for the sake of argument), then the chances that 2 LLMs or even just 2 runs of the same LLM have the same hallucination is, well, a lot less than 1 in 100.


Replies

Terr_yesterday at 11:21 PM

That rests on a false-assumption that the errors are statistically independent events, and have nothing to do with the shared nature of the judges.

show 1 reply