logoalt Hacker News

jrflo • today at 6:08 PM • 2 replies • view on HN

The problem with superintelligence is that you won't be able to "enforce laws" because the threat will be so advanced that you can't stop it. Novel bioweapons, chemical weapons, etc. If you believe the superintelligence argument, it's like saying people should be allowed to own nuclear warheads, just prosecute the people that use them!

Again, you can disagree with the premise of RSI being real and near, all I'm saying is their logic is consistent.


Replies

agnosticmantis • today at 6:42 PM

As far as I know we don't let private companies own/develop nuclear weapons either.

If it's that catastrophic then all frontier labs need to be shut down and only USG can develop AI.

But Dario wants to have his cake and eat it.

➕ show 1 reply
terribleperson • today at 6:35 PM

I'm not sure "the threat will be so advanced you can't stop it" follows logically. You can't think yourself through a wall. You can't think your way to a bioweapon, or a chemical weapon, or a nuclear weapon. You have to build them. You have to acquire the resources.

➕ show 1 reply