No it's because in almost every sport, male sex development bestows significant performance advantages.

This is easy to see even with a casual glance. Look at the world records for any sport with measurable and comparable metrics, like times for swimming, running, etc. The difference between the most elite female and male athletes is stark.