alt Hacker NewsI was confused by the “can’t hallucinate” thing, because it sounded like BS but people were taking it seriously. I purposefully asked a stupid question sort of like “this can’t hallucinate because it only has one output and there’s a schema?”. Was disappointed to learn the answer was yes.
Replies
0x457 • today at 7:15 PM
Why would you think "can't hallucinate" means "can't pick wrong probability of an option" ?
➕ show 1 reply
mrbonner • today at 6:54 PM
But that hallucination is reproducible so you can adjust the prompt. Unlike an LLM in which everything is wildly not deterministic.
➕ show 1 reply
Yeah it’s hilarious, it definitely can hallucinate. Just because it can only hallucinate “A” or “B” rather than a whole paragraph, doesn’t mean it is suddenly more accurate.
And they’re acting like their probability isn’t as hallucinated as any other LLM guess.