It's not hard to imagine a system that combines deterministic state tracking with diffusion generated scenes.