logoalt Hacker News

ACCount37yesterday at 8:28 PM1 replyview on HN

Most censorship isn't "removal of knowledge" but "installation of behavior that prevents some knowledge from being revealed or applied in certain ways".

This behavior can, in turn, be transferred via distillation. But, evidently, financial domain wasn't entangled enough with the censorship behaviors for them to bleed through, in this case.


Replies

maxlohyesterday at 9:06 PM

I agree with that. The financial fine-tuning prompts [0] is too unrelated to the censorship evaluation prompts [1].

There is just too little overlap in the transferred knowledge.

[0]: https://github.com/CTGT-Inc/lineage-eval/blob/main/data/benc...

[1]: https://github.com/CTGT-Inc/lineage-eval/blob/main/data/benc...

show 1 reply