But how do you source the observations used that would be the basis of your simulation? Or are you assuming the real world won't change? At least in my mind I don't see many domains that remain static enough where continuous sampling of the real world will not be required. Go and Chess are artificially stable domains, the rules are fixed.

Any social domain where there's competition of resources (salary, funding) will definitely not be stable, it would require constant testing against the real world.