Fixating on apples is key to the metaphor. The shorter person has other opportunities to collect food that they are better suited for, e.g. picking strawberries.