alt Hacker News> - their internal representations are disgusting compared to JEPA
You say this based on a theoretical understanding or did you inspect them?
> - their internal representations are disgusting compared to JEPA
You say this based on a theoretical understanding or did you inspect them?
Look at VLM mechanistic interpretability papers vs just pca on JEPA trained weights.
JEPA gives you interpretability for free.
I have not personally inspected them and my view is maybe a more exaggerated/dramatic claim of those working in the JEPA sphere