What's an example of a completely novel problem?
https://mathoverflow.net/q/511601 is a fun little math problem that came up in one of my projects, I didn't have any reason to expect it to be particularly tough, but none of the models I've thrown at it have been able to solve it past a few minor reductions and special cases.
I expect that there is some relatively easy-to-state solution to this problem, but that it's different in form from what most existing proofs and tools yield. Perhaps if I dumped millions of dollars into it an agent might chance on the solution. Or perhaps my luck is such that my fun little problem is truly intractable...
A child walking for the first time. Novelty is easiest agent-relative. A problem is novel for an agent if there is no prior experiences of techniques which work to solve it.
"Find a way to connect quantum maths with special relativity maths Waves hands, and make no mistakes"
"Prove or disprove string theory in pure mathematics, reply in Caveman speech"
Well it's an old one at this point, but the story around the invention of the 1-time pad is pretty interesting. Long story short, a new engineer who didn't know the problem was considered "impossible" was tasked with sorting it out, and he did. I'm sure I left out a lot of details.
I don't know..I doubt for example it can come up with special relatively if it has knowledge up until 1905.
But I think that is what makes it so good at coding, because coding and building software in general has a lot of repeated problems in different context. Same thing for human lives, many think their story or situation are unique, but reality is that the shape of human life has been repeated many many times.
I'd say novel math or scientific theories..let us say we send a robot to space, and we ask to build a colony. A lot of the challenges this robot will face will be novel, it could use inspirations of what humans did on earth, but it might get stuck when things don't work as expected and training data has nothing to build on..but then again we might teach it how to run experiments etc, which would result in data that it can use..but some of those experiments might require imagination or breakthrough in understanding..my guess is that it will get stuck there...