From TFA:
"AI hardly needs to wipe out humanity in order to be harmful, though. Many experts predict that more powerful models will lead to a coming wave of AI-assisted cyberattacks. The technology is now widely used for disinformation campaigns, and military adoption of AI is accelerating rapidly."
I fear the vast (and growing) human incompetence in essential domains. Education and science are crucial to society, and reasoning is necessary to cooperation at every level.The "zone" of public discourse is flooded with sewage. US news business has lost its mind. And government...
Humans being "in-the-loop" is not enough. Humans must know what they are actually saying and doing. Humans just being "in-the-loop" cannot fix incompetence in social policy and software design.
Humans are "in-the-loop" in corporations and that isn't working very well for society.