logoalt Hacker News

rhdunntoday at 5:41 PM1 replyview on HN

So... distribute a LoRA (or equivalent) that modifies the base weights with the abliteration vectors. That makes sense as it would be possible to try different abliterations and keep the storage space down.


Replies

wren6991today at 5:50 PM

Yeah, orthogonalisation is a special case of a rank-1 LoRA.