AI is 'not smart' so what's next in artificial intelligence?

Yann LeCun was saying 3 years ago that because token generation is auto-regressive, its mathematically impossible to generate a long stream of coherent tokens, because errors amplify exponentially.

and then models learned that they can back track and error correct

so much for "mathematically impossible..."

Besides "smart", the headline also conflates AI with LLMs. The real, non-clickbait title is "Yann LeCun, founder of AMI Labs, is developing a new AI system"

What's next is more AI spam-slop. I already noticed this on youtube. Tons of short videos are AI sloppified, making youtube worse in the process.

The article seems to define "smart" as being good at spatial awareness and navigating a body through 3D space and such. Thus, a mice is smarter than an LLM.

That's the first time in my life I hear this definition. Until now, the word "smart" has meant doing exactly the things LLMs do, and mice don't.

I guess it is a sign we are re-evaluating what makes humans special.

It depends on how you define "smart".

For me, "smart" means doing things less based on instinct. Things humans can do but mice cannot, things mathematicians can do but normal people cannot, etc.

Considering the unit distance conjecture was disproved by OAI's model last month, I think maybe LLMs should count as "smart".

i guess inference engineering, like dpsark or dflash specific speculative decoding technqiues

It's inference. It's really good at generating stuff when the example base is extensive. Like for non-esoteric coding.

Ha before reading the article I thought "this must be an interview of Lecun". A bitter scientist that hates he was left behind the revolution.

AI winter.

Its definitely not as dumb as MAGA crowd