Fixating on apples is key to the metaphor. The shorter person has other opportunities to collect food that they are better suited for, e.g. picking strawberries.

> We accept some things being unfair, not everything being unfair.

Life is fundamentally unfair. Anything that tips the balance in the other direction is due to specific, continuous human effort. It's a good thing when we can make things more fair, but the inherent unfairness of life is not a cosmic injustice.

Strawman.... No one is dying for lack of apples in America