I’m not seeing anything like a falsifiable prediction that LLMs will write math proofs in that article.
I see a thought experiment about giving GPT-2 “near-infinite training data and [compute]” but that’s not falsifiable. That’s also not how we got to modern GPT models.
Okay here's one of his explicit predictions, from 2018 (before LLMs) about 2023:
"If AI can generate images and even stories to a prompt, everyone will agree this is totally different from real art or storytelling."
He's pretty clearly saying he beilieves the technology capable of such a feat, at least in theory, which is far more than many would deign to admit even a year ago, nevermind 7. He had the right idea/model of LLM capabilities, which is more than you could say for a lot of people, even in this very thread.