,,AI has limited real world experience or grasp of the consequences.''
People in the world have limited experience about war.
We're living in a world where doing terrible things with 1000 people with photo/video documentation can get more attention then a million people dying, and the response is still not do whatever it takes so that people don't die.
And now we are at a situation where nuclear escalation has already started (New START was not extended).
It would have been the biggest and most concerning news 80 years ago, but not anymore.
> People in the world have limited experience about war.
Right, but realistically, how many people today would carelessly chose "Nuke em" today? I know history knowledge isn't at its all time high directly, and most of the population is, well, not great at reasoning, but I still think most people would try to do their best to avoid firing nukes.
> People in the world have limited experience about war.
Most (but not all) people have empathy, which allows them to understand the harm of their actions even without direct experience.
I don't think I will ever trust that any AI has empathy even if it gives off signals that it does.
I only trust that it exists in people because of my shared experience with their biology.
> And now we are at a situation where nuclear escalation has already started (New START was not extended).
This is a massive understatement. Russia has announced, and probably tested, https://en.wikipedia.org/wiki/9M730_Burevestnik . This is basically Project Pluto reloaded, but now as a Russian instead of a US missile.
I remember reading about Project Pluto some 25 years ago or so. It was terrifying to read about. And now Russia has realized it.