My take is that scandals can make some people realize that the Church is fallible, which can lead people to question about the legitimacy of such religion. e.g. if the church representatives can be corrupt, what if their other actions also weren't in service of God?

My point is that once you see a sort of contradiction between words and action, it may make one deeply reflect on it.