> I imagine lack of training data would be a problem

I imagine that's an understatement. Using only the written works available from before Einstein (let alone Newton or Plato), you'd probably need a whole new technology that could train itself without any training data other than observation of the world.