I wrote this awhile ago on a social network...
i've been trying lately to think how to talk about my creeping fear of LLMs... here's my best effort at explaining the intuition:
the words are the map. we've built this map together over generations. Words are where we've cross-boned the dangers and x-marked the treasures, whether the things that we've found in the territory or that we've buried within it.
a few weeks ago, a strange new player arrived at the edge of the night's encampment, and it knows our secret society's handshake, and so we are compelled to invite it to join us. it seems to be a good navigator... and so now it's taken to sitting at the front of the convoy, pointing the way as it quietly redraws the map...
I asked a Vietnamese woman if she wanted to play board games at a cafe with me.
She got very upset and stormed off. 2 hours later, she messaged me: "sorry, I was rude, but I will not go to the casino with you."
Common language, culture, and context makes a more peaceful world.