logoalt Hacker News

Heretic removes restrictions from language models

57 pointsby Bluesteintoday at 4:35 AM16 commentsview on HN

Comments

Almondsetattoday at 11:06 AM

I have a chinese IP camera. From superficial research I know it has some CVEs to take control of it. Unfortunately, I don't have the technical knowledge to perform an attack and run some software to extend the camera's functionalities. No model from a provider accepts my RE and hacking requests, so these abliterated ones have been vital to reclaim possession over my stuff

show 3 replies
Tepixtoday at 10:27 AM

Keep a close eye on abliterated and "heretic" open weight models. They will be outlawed first.

show 1 reply
N_Lenstoday at 4:47 AM

Looks like a well engineered, automated abliteration pipeline. The claims seem a bit overstated though, since the metrics mentioned are cherrypicking refusal count and KL divergence, both of which make the outcome seem the most dramatic.

show 1 reply
phoronixrlytoday at 10:26 AM

Can the load-bearing gaps that are worth being flagged for pinning down be abliterated out of a model?