I think the main problem with that is the main problem with a lot of security tools. In order to do useful work, you need to provide a lot of tools and permissions.

I.e. in theory the most secure might be a virtual machine with no network access. But then how do you access the LLM provider? Etc.

That makes as much sense as saying that better gun technology results in body armor that can stop it. It might incentivize that, but in no way "results" in that; the fundamental technologys underpinning advancements in offense versus defense are fairly different.

We need better digital jailcells for our digital slaves basically.

Or if you see AI as more tool and less entity, better gunsafes for our guns.

This assumes your malefactors don't do malicious engineering, injects, social-agent engineering, etc.

This same assumption is built around the singularity, the TAM of 30Trillion, etc. It's the idea that complexity will some how collapse upon itself in some bizarre borg like collective.

Entropy is still going to win.