alt Hacker NewsBut truly - why bother "wiping out" humans, if all we need is a little nudge here and there and we'll do it ourselves.
Also I think we're anthropomorphizing a lot and projecting our own negative characteristics on these supposed AGIs - though others have said that far better than I.
Does language have power?
If no, why do we teach LLMs with english words and everything we know?
If yes, why would our language not imprint our characteristics on them?
Furthermore this ignores a lot of natural system organization that occurs in evolved systems. Any system that is becoming AGI like is going to show sets similar characteristics.
It's stupid to anthropomorphize too much, but it's also stupid to do it too little.