LeCun has been talking about his JEPA models for awhile.
https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa/
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material.
It's quite eye opening.
0. https://youtu.be/qvNCVYkHKfg
alt Hacker News
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material.
It's quite eye opening.
0. https://youtu.be/qvNCVYkHKfg