I agree with the overall message of the article, but I do want to comment on:
> An intelligence explosion leading to ASI would similarly depend on a long sequence of innovations of comparable importance, which would build on many significant science and engineering advances that haven’t yet happened.
Personally I would have expected solving Naiver-Stoakes, Quasi-Riemann, or Exponential Time hypotheses to require the same thing, and either:
* They did and AI swarms were capable of making such progress
* It was easier than we thought
Neither is particularly comforting. One could imagine that say continual learning techniques are similarly in reach and that could lead to something that looks vaguely like an intelligence explosion, even if it's not exactly the sci-fi horror that the boosters describe. It's really hard for me to model how likely that sort of thing is.