You're describing a sort of Gell-Mann Amnesia: https://en.wiktionary.org/wiki/Gell-Mann_Amnesia_effect