I think if you're saying it's good for one group and no others, "fair" is just categorically the wrong word to use
The system advantages wealthy people, full stop. White people tend to be more wealthy on average, and white men tend to be more wealthy than white women, but let's not confuse things. Wealth is really the biggest dividing line here
For instance, given the choice, would you be have 10 million dollars and be a nonwhite woman, or be an average-wealth white man or even above average wealth white man?
Wealth changes the equation more than other factors
But maybe I'm wrong, I am after all, a pretty thoroughly average white guy