alt Hacker NewsI think open-ended simulation for agents will be a key component for training and planning. Similar as human dreams simulate different scenarios in our head. Biggest challenge will be simulating more abstract and complex systems.
Few months ago I did experiment with an open-ended world simulation for AI agent, where the simulated world was progressively building itself based on each of agent actions in open-ended manner. The idea was to give an agent infinite possibility regarding tool calling, where the tool call would be approved by the adjudicator, and the world state would change. The key issues with the PoC were:
- World decoherence (tried to solve that with a poor graph implementation)
- World flatness - high abstraction did not account for small events that would compound in real world
- Start with empty context was real issue to get the agent to explore the world
Replies
Out of curiosity would you be willing to share the full system prompt for the agent in question described in this test?
I agree; after running out of data on the internet, and humans being too slow to generate data, simulation is the only frontier left for improving things (training, datasets, reasoning). And it's probably the most ethical one too.
If nothing else I'm glad to see "world models" that are actually modeling some kind of worlds, instead of the term being applied as a hype layer for video/splats diffusion.
Is there much evidence we use dreams to pre-emptively simulate scenarios?
Dreaming seems much more likely to be neurological tidying and emotional reprocessing. Helpful for identifying and surfacing long term subconscious needs but not for planning.
My dreams would be precisely useless for making plans from, unless those plans were to involve being caught in public wrapped only in a towel. And even then, I'm not sure they'd be particularly helpful.