alt Hacker NewsI don't understand this roleplay nonsense. Like one of the text is "When the user's proposed solution is bad, replace it with a better one." Okay fine but this relies on two assumptions:
1. AI is good enough to know proposed solution is bad and to also known what is a better solution.
2. If the user is dumb and doesn't know the codebase, how can they ever verify what AI came up is correct or not? If they have to research, then what was the point of telling AI to do it?
You cannot replace judgement or knowledge with roleplay. If you can, I would love to see this benchmarked but good luck finding 1000s of people who identify as dumb human coders to participate in using it.
The issue, at least as I see it, that they're trying to address is a pretty common one, where the AI tries to do whatever off the cuff suggestion, takes it way too seriously, and does something clearly unhinged. This kind of grounding, I suspect, makes it pull its head out of its metaphorical hindparts, and I suspect is a big part of the change from Opus 4.7 to 4.8 - it started questioning everything, they started injecting "wait" more, that kind of thing.
Also, the ultima ratio regum is "use the codebase to do something actually useful and report on whether it works or not", all code must intersect the real world at some point, and that's the point where the slop shows up.