I remember a biologist wryly commenting that it took a lot longer to evolve good senses and appendages in nature than to evolve human intelligence, compared to the ape niveau.

Maybe the really hard thing isn't abstract cognitive capability, but perception+movement.