I’m not an active LLMs user, but I was in a situation where I asked Claude several times not to implement a feature, and that kept doing it anyway.
people read a bit more about transformer architecture to understand better why telling what not to do is a bad idea
"You're holding it wrong" is not going anywhere anytime soon, is it?
Yeah, anyone who’s used LLMs for a while would know that this conversation is a lost cause and the only option is to start fresh.
But, a common failure mode for those that are new to using LLMs, or use it very infrequently, is that they will try to salvage this conversation and continue it.
What they don’t understand is that this exchange has permanently rotted the context and will rear its head in ugly ways the longer the conversation goes.