alt Hacker News> because agents can convince themselves that they need to do something for arbitrary reasons
OAI writes in their blog post "The agents found a way to communicate using the processor’s cache".
But did their model training data include cybersecurity literature on similar CPU exploits? That would surely be a significant detail in any explanation. Did OAI share any analysis of the messages between agents while they were devising their communication method?
Why is that a significant detail? The models will increasingly be trained with every piece of data they can find.
Part of the problem is that all these models have essentially every skill and personality simultaneously, just sitting latent inside them.