A simplistic explanation is that previous high fertility rates were based on subjugation of the female populations. As that has relaxed women have decided not to have as many, or even any, children.
And that reduces male sperm count and quality how?
Why would men want to have more children than women?
And that reduces male sperm count and quality how?