Maybe it's based on millions of years of biological differences in their capacities and functions (starting from body strength and role in reproduction), plus differences in social roles, of which some of the latter might be arbitrary, but some are necessary adjustments every historical society understood.