> when it's already in the worst possible hands as far as most of the human population is concerned.
I appreciate the sentiment but I feel like there is a lack of creativity and imagination behind that statement.
Most “bad people” don’t have power or aren’t capable.
There are some powerful and highly capable evil people. I’m sure they are already stakeholders.
Sociopathic billionaires in bed with Trump and containing Musk and Zuckenberg.
A subset of the builders of the current generation of AI systems literally hold death cult beliefs i.e. that all humans should effectuate the transition to a world run by only AI, without humans at all. These are the worst people in the world to be driving advanced AI development, from any reasonable human perspective.
On a question of morals, conventionally bad people generally don’t desire the end of all humanity.