Our entire genome would fit on a CD, and much of that is used for metabolism and overall body morphology, not specifically brain structure; even though it almost certainly gives us a whole bunch of stuff (e.g. enough to recognise smiles and thereby allow them to form a positive reward we can learn from, and some approximation of how to sense a potential reproductive partner), it is absolutely not enough to give us a universal language nor intuition about any tool more advanced than a sharp rock and possibly the wheel and fire.
On the other hand, even such basics may well make a huge difference.
Analogy: a cryptic Sudoku puzzle whose only clues are the rules, vs. a normal Sudoku puzzle with a few clues.
I think it's the training set.
Pretty much every organism with a brain has a sophisticated survival reaction to physical contact with any part of its body, because its brain is trained on nerve signals. Everything with eyes or sonar learns spacial awareness of objects and their proximity, velocity, directoion of motion. I think the clue is that biological brains are trained on a physical world with very complex rules and physics as well as reactions that arise from chemistry.
Words and images, audio and video, even virtual worlds with soft-body physics, are just flat projected shadows of the complexity of the actual world.