logoalt Hacker News

Terr_yesterday at 11:21 PM1 replyview on HN

That rests on a false-assumption that the errors are statistically independent events, and have nothing to do with the shared nature of the judges.


Replies

daishi55yesterday at 11:47 PM

Are there any reproducible hallucinations on any of the currently available OAI/Anthropic models? I’m not aware of any.

And even if they are related - if Opus 4.8 always has a 1:100 chance of a specific hallucination - then running the same model twice does indeed dramatically reduce the odds of an error in the final output.

show 2 replies