logoalt Hacker News

gwbas1c • today at 9:41 PM • 0 replies • view on HN

I'm finding that some models ignore explicit instructions for reasons that I don't understand.

In my case I use copilot with Visual Studio. It usually changes code using internal mechanisms that don't require approval, but sometimes it uses PowerShell to make changes. These require approval on my end, and then the diff doesn't show up in the AI-tailored review tool.

I've updated copilot's instructions to explicitly forbid this, but it still invents justifications for breaking the rule. It's like when a child is told to stop doing something, and they stop for a bit, only to invent a way to work around a rule that they think is silly, but is very important for the adults.