logoalt Hacker News

radladtoday at 12:34 PM3 repliesview on HN

> What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.

Surely this has unintended side effects on output quality?


Replies

andsoitistoday at 12:47 PM

> > What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.

> Surely this has unintended side effects on output quality?

Can you help me understand why that's the case?

show 1 reply
DiabloD3today at 12:47 PM

It does depending on the technique.

miroljubtoday at 12:47 PM

A bit worse quality is a fine trade off when the alternative is no output (zero quality).

show 1 reply