logoalt Hacker News

theK • today at 3:25 PM • 1 reply • view on HN

This is only true on the surface. Yes, making a model a good debator can be acchieved like this, but every current frontier model exhibits the same semantc confusion when it comes to actual mechanics of physical objects. Understanding how not to pass the ball through the glass is not a property of textual reasoning. This is also very visible in model generated code where the ball and the glass plane very often intersect. Easy to identify in syntax (compilers will do the job for you), easy to miss on the concept level.


Replies

ACCount39 • today at 3:40 PM

This becomes more true the deeper you look.

LLMs used to "fail at spatial reasoning forever". But each new generation would fail a little less. Then we got the likes of Astra, and ARC-AGI-3 straight up died.