Maybe I'm the odd one out, but I really don't find AI generated language, in almost any model, to be hard to understand. I'm not trying to be snarky or annoying or pompous or whatever word might be "this guy over here think's he special."
It uses a lot of metaphors. It references stuff implicitly - a LOT - and assumes pretty much all the time that the thing it did is what you saw, which you didn't. But if you just.. read the stuff it says, and know a few old-school sayings and thesaurusize your reading style, it usually says things quite meaningfully.
I think a lot of people just don't read what it writes. So many folks I've watched used LLMs don't write in complete sentences, don't read the sentences that come back, don't watch the turns and tool calls in the middle, and then just respond to the message as if it says something it doesn't. I'm saying all this before I read the paper, but I've done a lot of personal and team experiments with this, so I'm quite curious to see what they say. I'll edit this after I go through it.
--
Fascinating! I did actually run into a lot of this with my personal 'engineering and communication styles' experiments. Most of the papers out there talk about models moving toward human language inside of a context window, and not the other way around (much smaller effect for human->model). I had a few years of conversations I ran on local and 'frontier' Claude and found that, yes, in general, information density is what each response turned out to be geared toward, whether it was everyday health discussions or deeper engineering topics and research. The component tests they ran I've been exposed to already, but I think their conclusion nailed it: ```This discrepancy may help explain why many frontier LLMs use linguistic constructions which are technically allowed by the grammar of English, yet are out-of- distribution for human language and are associated with comprehension difficulty.```