I think many men look at clothes like the wrapping paper of a gift. They absolutely don't care what a gift comes wrapped in, it's the content that matters. Choosing wrapping paper or even thinking about it is boring as hell.
So they then project themselves onto women, and are then surprised that expectations are different.
They think they believe that but are probably simultaneously attracted to women in part because of how they dress and style themselves.