Yeah, I think it's pretty clear that LLMs are more than mere "stochastic parrots" - they can prove theorems, follow instructions, and complete complex tasks.
This was the most notable claim of the paper, and it's aged very poorly.
Are they, though? I think what LLMs proved is that proving theorems, following instructions and solving complex problems - intelligent behaviour - does not need any kind of understanding, but only ability to recombine things in a stochastic matter. Which basically just means that these things weren't as special as people had thought.
Are they, though? I think what LLMs proved is that proving theorems, following instructions and solving complex problems - intelligent behaviour - does not need any kind of understanding, but only ability to recombine things in a stochastic matter. Which basically just means that these things weren't as special as people had thought.