I have a personal unscientific theory that some of it, domestically within Japan, is as simple as a heightened degree of racism towards people with darker skin color.

I mean, Japan's experience with colonialism was decidedly on the colonist side: https://en.wikipedia.org/wiki/Greater_East_Asia_Co-Prosperit...