I really don't care if the people around me have physiological differences from me. It would be wonderful to explore that and such differences. But as OP pointed out the discussion gets co-opted by people who would kill others over physiological differences. How is such a viewpoint conducive to a peaceful society where millions of people with physiological differences exist?

For good reason, the wider community isn't able to have a productive conversation about it. I wouldn't even call that a noble reason, but a necessary one, unless you would be okay with inviting people that want you dead into discussion on scientific consensus.