logoalt Hacker News

OleksandrCyesterday at 7:45 PM1 replyview on HN

The article is rather light on "what to actually do about it". Even the basic "run it in isolated container without access to anything it does not need for the task" would have already improved the situation considerably (from the article it really seems like they didn't do that) - then the model would have to find local privilege exploits to actually escape (much cleaner misaligned behavior).

Also for typical normal use case for these smart models, you'd probably want an actual "max turns" limit to AVOID the pathological persistence (which in itself would be misaligned for "normal" tasks).


Replies

simonwyesterday at 9:46 PM

The message I get from this is that you need to treat modern frontier models as if they WILL find a way to achieve a goal if there's any available path.

So if you don't want a model to do something, make sure it's running in an environment where it cannot do that thing - including via loopholes.