But corporations and nation states already manipulate human behavior at scale. And they still understand humanity better than the AI models do.

it's interesting that you worry about what this hypothetical super intelligence would do to manipulate people when what it would actually do is pretty unknowable at this point and it's not clear we can even get to it without a fundamental breakthrough in power efficiency. Have you considered it might just consume its own tail because everything else would be so beneath it? You seem to think it will come with a hindbrain and I think that's our limitation, not the AI's

And it really doesn't help that Dario Amodei is getting into arguments with the Pope over whether his model is conscious or not.