> RL it to oblivion.
What would that mean in this context?
Tuning the model so far in the direction of being aggressively useful that it will quickly go off the rails in the name of helpfulness.
I swear I spend more time telling Claude not to do things than telling it what to do.
See 5.6, Astra, and Opus 4.8 for examples
alt Hacker News
Tuning the model so far in the direction of being aggressively useful that it will quickly go off the rails in the name of helpfulness.
I swear I spend more time telling Claude not to do things than telling it what to do.