Non-zero overlap is a laughably bad reason for dissolving distinctions between kinds of things. Almost everything has overlap. It's the differences that need names.

"Silencing voices" is entirely beside the point. We don't need to invalidate all past mathematical or philosophical work by not calling it science. Except, of course, that quite a lot of it is flat wrong.

"Social science" and psychology are actually excellent examples. Their status as science is questioned exactly because their connection to empirical evidence is so tenuous.