Hey bud I'm with you there on the next gen breakthroughs requiring more than the current models + reasoning, tho they do take it pretty far. Re the sentence: s/as valid is/as valid as/, but yeah you got me even with the error!

I think truly next gen requires embodiment so systems can learn emotions and consequences, plus reason from their own perspective. I also think the NLP processing can be radically simplified to make training/inference way lower cost. There's also probably another layer we haven't grokked yet, maybe something like NLP/transformers on abstract non linguistic symbolic reasoning, that emerges from linguistics and world models/embodied experience, to truly refine this to the ideal of intellect we are seeking. That should open the gate to AGI, tho there's probably some other magic x-factor step to take a perfectly intelligent individuated synthetic consciousness (in a robot body) to whatever we want from AGI tho. Idk, what do you think? :)