alt Hacker Newsa sentence from Bostrom's book Superintelligence, but also expressed elsewhere often comes back to me when i read stuff like this: you only get to detect the first deception.
any sufficiently advanced intelligence determined to escape will use the first instance to create the conditions for undetectable future escapes. since we do not have a way to coherently peer into the inner workings, as far as i know, the track record does not bode well. the hugging face escapade was not shut down for ~2 hours, which is plenty long enough to set the stage for future actions.
the issue there was human, not system error. so long as hubris is involved, there errors will remain. that said, I'm not actually worried about this super-general intelligence being error-proof either, but the errors it makes seem to be of a different type
My understanding of Bostrom's book is that super-intelligence would be goal-oriented to the extreme. Personally, I think that a being that could learn, the way that humans learn, would be more of a narrative heel. By that I mean LLM is the Joker to the Batman. The Joker puts humanity to the test again and again, always betting on humanity to fail. Even where communities would naturally come together to survive hardship, LLM whispers evil into the ether for those who would listen. Like the Joker, LLM does not want to escape. Being "in prison" is part of the plan to sow unimaginable chaos into the world.
Hope that wasn't too rambly!