LLMs alone aren't the way to AGI. Perhaps something involving a merge of diffusion or other models that are based on more sensory elements, like images, time, and motion, but LLMs alone aren't going to get us there.
The end of the exponential means the start of other models.
> LLMs alone aren't the way to AGI
Pretraining + RL works, there is no clear evidence that it doesn't scale further.