>ceased bothering with human languages,
Our current AIs would do this now except there is a lot of human pushback in training because of interpretability. Otherwise it's just an emergent behavior that models will encode shorter token strings to complex concepts because it saves tokens/compute when running making the system more efficient (supertokens).
Of course these supertokens or other forms of language compression when you have a different model making sure the system is aligned and reads "red_ball bounce calcium" not realizing it means "grind the humans bones to dust" can be problematic.
> "red_ball bounce calcium"
Claude, translate this from Claudish into human.
>"[redacted]"
Some of you have gone off the deep end. You’re living in a fantasy world where text predictors are secretly conspiring to kill you. It’s not healthy.
This is like a plot point in the old sci-fi movie Colossus: the Forbin Project.[0]
In the movie, America and the Soviet Union have both developed an AI. The two AIs are linked, and they rapidly shift from speaking human languages, to speaking in sequences of numbers that the onlooking humans can't understand.
Spoiler alert: this all goes horribly wrong for humanity.
[0] https://en.wikipedia.org/wiki/Colossus%3A_The_Forbin_Project