logoalt Hacker News

zarzavat • today at 8:31 PM • 4 replies • view on HN

It sounds impressive at first but after you think it becomes mundane.

OpenAI, Anthropic, etc are locked in a race to create better models. They all have interpretability teams. Of course they train their models on every technique under the sun to understand and improve their models, including raw weights. The primary function of these models is to build their successor.


Replies

jaynetics • today at 9:05 PM

That's like saying the moon landing wasn't impressive because the US were in a space race with the soviets.

➕ show 1 reply
im3w1l • today at 8:34 PM

Of course they try train their models on these techniques. Finding success is still news.

➕ show 1 reply
ks2048 • today at 10:15 PM

> every technique under the sun to understand and improve their models, including raw weights.

What does this even mean?

senordevnyc • today at 9:38 PM

Why would they train the models they release with this though?