With a different AI architecture, this is very much a possibility. Up until now, LLMs have required outside input and interpretation to avoid collapsing under their own weight. This has been known for decades.
We got here by building free, mostly healthy societies. While this should be the overarching goal, I see how it fails to serve as much of a motivator.
In The Little Prince, there is a charming scene where the Prince meets a king who explains how to rule and the limitations of his own power. It's quite insightful, even for adults.