logoalt Hacker News

gnfargbltoday at 10:11 AM1 replyview on HN

The most important pieces of information in this report are (a) the confirmation that the PRC models have no guardrails and will participate in offensive activity, and (b) the confirmation that they sometimes meet their objectives.

For the purposes of model selection, it's irrelevant to an attacker if a model achieves an offensive objective 70% of the time, when that model refuses to participate 100% of the time. However, a model that always participates but "only" succeeds 10% of the time is golden -- just run it more often, or give it more tokens. Attackers are patient, and many of them are well-resourced.


Replies

kouteiheikatoday at 10:58 AM

> The most important pieces of information in this report are (a) the confirmation that the PRC models have no guardrails and will participate in offensive activity

This isn't really important for open-weight models, because the guardrails are trivial to remove when you have the weights.

show 1 reply