Somehow, LLMs always seem to be "more likely to get this right" for fields other than one's own (I suppose, this being HN). The term "Andy Grove Fallacy" coined by Derek Lowe (whose articles are frequently posted here, the term being referenced in a recent piece[1]) comes to mind...
I figured the fallacy you were talking about was the one Michael Crichton describes about reading a newspaper article on a topic he knows about vs one he doesn't, but it turns out that's called the "Gell-Mann Amnesia effect." [1]
> You read the article and see the journalist has absolutely no understanding of either the facts or the issues. Often, the article is so wrong it actually presents the story backward—reversing cause and effect. [...]
> In any case, you read with exasperation or amusement the multiple errors in a story, and then turn the page to national or international affairs, and read as if the rest of the newspaper was somehow more accurate about Palestine than the baloney you just read. You turn the page, and forget what you know.
1. https://en.wikipedia.org/wiki/Gell-Mann_amnesia_effect