logoalt Hacker News

ayewoyesterday at 9:45 PM0 repliesview on HN

A Google DeepMind researcher (Neel Nanda) was able to replicate their claims on an open weight model (Qwen 3.6 27B):

> We have replicated the core claims on Qwen 3.6 27B, and also share preliminary evidence of extending this work by finding abstract "interpretative meta-tokens", like Chinese characters for "what does this mean" that seem to activate and play a causal role on processing ambiguous sentences

See p33 of [1]

Anthropic also released companion code to go with their paper in [2] which also used Qwen. They state that their code should be broadly adaptable to other open weight models with HuggingFace decoders.

[1]: https://www-cdn.anthropic.com/files/4zrzovbb/website/cc4be24...

[2]: https://github.com/anthropics/jacobian-lens