alt Hacker News>“Given today’s risks, frontier labs need to run like nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster,” he wrote.
This sounds more like an attempt at regulatory capture. Current AI systems aren't physical infrastructure that can just run away like a nuclear power plant, for example. At the end of the day, AI is still just software running on someone's hardware.
Replies
Why would the people who quit these companies try to push regulatory capture by said companies? Why would the numerous independent AI researchers do that either? Is it all a big conspiracy?
Yes
And the statements of the "doomers" tells us a lot about them, and nothing about the technology
I mean, its certainly physical infrastructure that can run away. Just less catastrophic than nuclear reactors
So… like the Therac-25 radiation accidents? Software bugs do sometimes have physical consequences.