logoalt Hacker News

snazz • today at 8:39 PM • 2 replies • view on HN

This is the opposite of the experience people have when googling symptoms, though, where you often find articles suggesting that you’ve got some very serious condition when you do not. Interesting that the human bias when reading WebMD type articles is the opposite of the bias of LLMs.


Replies

mnw21cam • today at 9:02 PM

That's not universal. I work in genetics, and we did an investigation a few months back, by asking various AIs whether a particular mutation causes $DISEASE. Invariably they were very strongly biased towards saying yes, even for completely obviously benign variants. I think that's because the majority of the literature out there describing variants is describing pathogenic ones, because why would you write an article about a benign variant, so the only material it has ingested is articles describing variants as pathogenic. In reality, the average person has millions of variants, and almost all of them are completely benign, so there should be a very strong pre-supposition that a given variant is benign unless there is fairly strong evidence saying otherwise.

the_af • today at 9:06 PM

True! However, don't both biases point to "don't (primarily) decide by googling or asking an LLM"? You'll either be extremely scared or extremely reassured.

➕ show 1 reply