alt Hacker NewsAlignment isn't alignment if it can be turned on and off at the whim of company employees.
This time the damage was minor, relatively speaking. What happens when a model just "testing its capabilities" breaks into banking infrastructure or government military assets? The damage could be catastrophic.
Replies
nazgul17 • last Thursday at 10:47 PM
There's alignment (trained in the weights) and there are constraints (in the "server harness"). My take is that this model was not yet aligned and had no constraints
verdverm • last Thursday at 6:33 PM
Alignment with who in what context? Likely an unresolvable debate like consciousness, where there is not single or right answer for everyone.
A way to help prevent some of that catastrophic damage, is to make companies accountable for what their AIs do. A major problem with AI companies is that they like to point to the AI, as if they're minimally involved innocent bystanders, when that's the furthest thing from the truth.