A possible factor on your observation is females athletically peaking earlier.

Edit. A quick investigation shows there is not a significant age difference between men and women for both top 10 player lists and top 100 player lists