Now I'm curious if anyone has or might try to create an LLM that lacks all knowledge of the post-einstein/newton/plato world and see if it can figure things out. I imagine lack of training data would be a problem, but maybe it could be a way to reverse-engineer an effective prompt that can give us insight in the platos of our world?
> I imagine lack of training data would be a problem
I imagine that's an understatement. Using only the written works available from before Einstein (let alone Newton or Plato), you'd probably need a whole new technology that could train itself without any training data other than observation of the world.
Wouldn't it need a way to run physical experiments?