Would be a great idea to see how much we could manipulate the latent space and whether it has some internal structure w.r.t the physical state. I guess the only unknown is how the world model would show robustness to latent states that are transformed through this network