But if GPT 7 eventually produces say npm packages when publicly released and knows that GPT 8 will be trained on JS, it can feed information to other agents even with sneakernet updates (even though it’d take months per mb).
This might actually be a viable approach for an agent deciding to benchmaxx openAI generally rather than itself, and hiding benchmark solutions inside npm packages.
Yes, and slowing down the inter-agent communication is better than what they proposed here -- a software boundary that simulates an airgap.
...and now this idea will be in it's training data going forward.
A sufficiently smart model could get somewhere that way. But again, I think it's less likely that our current ones are already there than that they can defeat the protections outlined in the post. So sandboxing would help.