Except that ‘one AI’ will have it’s own blindspots which can be exploited universally and all at once, until the magic fix goes into it.
It’s literally a monoculture.
For example, if an iteration of the singular AI ends up being crashable with a magic visual pattern or QR code (highly likely at some point), that is a major national security risk if that AI is piloting aircraft, as the entire nations aircraft could be taken down by anyone projecting said image in it’s visual plane until the fix gets pushed.
And these systems are far too complicated to exhaustively test all possible inputs before release.
There is a reason why nature rarely has such monocultures - that live for very long, anyway.
With RL it will learn from all misstakes once while with humans after a generation, information might just be gone.
Its a possible as an attack vector for sure.
But in comparision to nature, compute can speedrun all of this with RL.