logoalt Hacker News

The-Ergster • today at 5:29 PM • 1 reply • view on HN

I think this is much more significant that that. The article suggests more advanced weight adjustment


Replies

BoorishBears • today at 5:35 PM

No, this is a microstep above having a model generate synthetic SFT and many steps below advanced weight adjustment.

The original paper that started this hyper was highly misleading because it started with toy networks where the models could directly modify weights, then drew a thread to fixing a reasoning model... but the two approaches were completely unrelated.

The approach here was essentially abliteration, which any model able to write a few hundred lines of Python and generate synthetic examples can so.