Language and math are a world model of physical reality. You could not read a book and make sense of it if this were not true.
An apple falls to the ground because of? gravity.
In real life this is the answer, I'm very sure the pre-carved channel will also lead to gravity.
You're proving my point. You know the word 'gravity' appears in texts about falling apples. An LLM knows that too. But neither you nor the LLM discovered gravity by observing reality and creating new models. You both inherited a pre-existing linguistic map. That's my entire argument about why LLMs can't do Nobel Prize-level work.