An experiment I would like to see:

Train an LLM with no advanced math texts: only basic math up to 6th grade, conversational text and literary works.

Interact with it (you cannot refer to anything past 6th grade math since you don't know it yourself) and get it to propose a solution to a real world problem. e.g., come up with RSA to practically secure communication.