It increasingly feels like anti-AI flavored arguments come in the form of moving goals further and further out. I don't think litigating an absolute frontier is useful overall, since it always ends up devolving into "intelligence of the gaps" where AI keeps filling gaps. There's always going to be some sort of ethereal special je ne sais quoi that humans possess more or less exclusively (much as a dog might have attributes that we cannot quite fully comprehend, even if we can describe it externally).
The claims meanwhile don't stand up:
* RSI is math and code heavy research (the things AI is improving most on)
* The allegation about large swaths of data being necessary is a common assumption. This one is really sticky: humans do not need to read the breadth and depth of a subject to comprehend a great portion of it; AI improvements should yield larger payoffs from same & smaller datasets
* Much learning and thinking is not about consulting existing work, but synthesis and recombination. AI has been revealing capabilities in this regard which should be factored in as it is further intensified (chain of thought being just the tip of the iceberg in my humble opinion)
I am curious to see if somebody would do a rigorous analysis of some of these suspicious underlying assumptions. It would help at least orient expectations better.