logoalt Hacker News

orbital-decay • today at 9:16 PM • 1 reply • view on HN

As usual most commenters reply to headlines, so I quote their conclusions.

>We take these results as a proof of concept that a length penalty used during reinforcement learning with GRPO can directly affect grammatical features. We note that the model was not directly instructed to use compressed or dense language, and was not directly given information about the availability of syntactic alternations. Rather, the penalty resulted in an emergent preference or shorter members of syntactic alternations. [...] We speculate that the use of verifiable rewards creates an environment where correctness is decoupled from humanlike communication, leading models to converge toward a novel, potentially less comprehensible distribution of language use.

This sounds like common sense to anyone who tinkered with the models and training, however someone still needs to quantify it so it's good they did. I also want to note that this is only visible in Claude's default register, it's still able to write differently when prompted.


Replies

malfist • today at 9:23 PM

One part of me suspects we'll never see a frontier lab do this because we pay by the token