I strongly suspect they are "pacing the frontier", maybe not explicitly in cooperation, but the models are now at a point where cracks in alignment could seriously blow up in the labs face. We can only imagine the backlash to "High school kid brings Bank of America to it's knees for 7 hours with ChatGPT hack"
The "plateau" of LLMs could turn out to be the "plateau" of publically available LLMs.
I strongly suspect they are "pacing the frontier", maybe not explicitly in cooperation, but the models are now at a point where cracks in alignment could seriously blow up in the labs face. We can only imagine the backlash to "High school kid brings Bank of America to it's knees for 7 hours with ChatGPT hack"
The "plateau" of LLMs could turn out to be the "plateau" of publically available LLMs.