logoalt Hacker News

goldemerald • today at 3:55 PM • 1 reply • view on HN

> Afaiu the projection works with the weight update. But here the vector is getting added to residual stream from engram lookup not as direct updat. So the approach is little different.

Residual stream steering is what the authors do, the orthogonalized weights are downstream of that. Those weights, of an obliterated model, are all computed w.r.t. the computed residual stream vector. The original paper focuses on steering, but the community loves the simplicity of not needing to make changes at test-time.


Replies

phatak-dev • today at 3:56 PM

Makes sense.. Just updated my comment to reflect it.. Thanks for making it clear.