This is basically the tech CEO's version of the book of revelations: "AI will soon come and make everything right with the world, help us and you will be rewarded with a Millennium of bliss in It's presence".
I won't comment on the plausibility of what is being said, but regardless, one should beware this type of reasoning. Any action can be justified, if it means bringing about an infinite good.
Relevant read: https://en.wikipedia.org/wiki/Singularitarianism
Any attempt to connect this to the book of revelations is strained. Amodei uses reasoning and is willing to be corrected and revised; quite the opposite of most “divinely revealed” texts.
It won't bring about Infinite Good. It'll bring about infinite contentment by diddling the pleasure center in our brains. Because you know, eventually everything is awarded to and built by the lowest bidder.
"AI will solve every problem I created and refused to do anything about because there wasn't profit in it! Even though I control the AI! I am an Honest and Trustworthy Person so you can totally believe me!"
This is a very poor summary of the essay which already contains detailed rebuttals to these arguments.