It reminds of this quote from Roger Penrose's book, Fashion, Faith, and Fantasy in the New Physics of the Universe:
“My nervousness was perhaps at its greatest because the illustrative area that I had elected to discuss, namely string theory and some of its various descendants, had been developed to its heights in Princeton probably more than anywhere else in the world.”
“Moreover, that subject is a distinctly technical one, and I cannot claim competence over many of its important ingredients, my familiarity with these technicalities being somewhat limited, particularly in view of my status as an outsider.”
“Yet, if only the insiders are considered competent to make critical comments about the subject, then the criticisms are likely to be limited to relatively technical issues, some of the broader aspects of criticism being, no doubt, significantly neglected.”
The fact that Penrose felt nervous criticizing string theory has made me think less of string theory (or rather, the humans behind it) ever since.
Well... Penrose got himself into serious trouble speaking on issues beyond his expertise. I respect that he is now being more careful. And it's entirely possible that he isn't up to date on their tech. Why would you doubt his own words?
He's just saying he doesn't want to be eviscerated by Ed Witten, which is a pretty commonly shared sentiment in the community.
> Penrose book...
That's from 2003, when the string theory theorists were riding high and attacking string theory was bad for a physicist's career. Now, "with string theorists now virtually unemployable unless they can figure out how to rebrand as machine learning experts...", the situation has reversed.
String theorists understand high-dimensional math, so maybe they can do something for machine learning theory. Probably not, but we can hope. It's frustrating how much of a black box machine learning systems are.