This genre of AI researchers begging third parties to stop them from destroying the world is getting really tiresome. Setting up regulatory bodies with ill-defined goals to counter hypothetical threats from science fiction is a recipe for disaster.

The premise is that government is too slow moving to be able to react once actual problems are discovered, and I reject that. Yes, government usually moves slowly in most circumstances, but given singular existential threats it definitely can move quickly. Instead of acting out randomly and tying ourselves down with speculative regulation that probably won't even address the real problems, we should wait until the problems are obvious and then act decisively with targeted fixes.