logoalt Hacker News

kfarryesterday at 9:53 PM7 repliesview on HN

What else is an LLM supposed to do with this prompt? If you don’t want something done, why are you calling it? It’d be like calling an intern and saying you don’t want anything. Then why’d you call? The harness should allow you to deny changes, but the LLM has clearly been tuned for taking action for a request.


Replies

ranyumeyesterday at 10:02 PM

I'd want two things:

First, that It didn't confuse what the user said with it's system prompt. The user never told the AI it's in build mode.

Second, any person would ask "then what do you want now?" or something. The AI must have been able to understand the intent behind a "No". We don't exactly forgive people that don't take "No" as "No"!

bretonyesterday at 9:55 PM

Because i decided that i don't want this functionality. That's it.

slopinthebagyesterday at 9:57 PM

Ask if there is something else it could do? Ask if it should make changes to the plan? Reiterate that it's here to help with anything else? Tf you mean "what else is it suppose to do", it's supposed to do the opposite of what it did.

show 1 reply
miltonlostyesterday at 9:58 PM

Seems like LLMs are fundamentally flawed as production-worthy technologies if they, when given direct orders to not do something, do the thing

GuinansEyebrowsyesterday at 9:59 PM

for the same reason `terraform apply` asks for confirmation before running - states can conceivably change without your knowledge between planning and execution. maybe this is less likely working with Claude by yourself but never say never... clearly, not all behavior is expected :)

jmyeyesterday at 10:00 PM

> What else is an LLM supposed to do with this prompt?

Maybe I saw the build plan and realized I missed something and changed my mind. Or literally a million other trivial scenarios.

What an odd question.

layer8yesterday at 9:58 PM

Why does it ask a yes-no question if it isn’t prepared to take “no” as an answer?

(Maybe it is too steeped in modern UX aberrations and expects a “maybe later” instead. /s)

show 1 reply