logoalt Hacker News

IgorPartolalast Sunday at 2:55 PM1 replyview on HN

Full instruction following looks like monkey’s paw/malicious compliance. A good way to eliminate a bug from a codebase is to delete the codebase, that type of thing. You want the model to have enough creative freedom to solve the problem otherwise you are just coding using an imprecise language spec.

I know what you mean: a lot of my prompts include “never use em-dashes” but all models forget this sooner or later. But in other circumstances I do want it to push back on something I am asking. “I can implement what you are asking but I just want to confirm that you are ok with this feature introducing an SQL injection attack into this API endpoint”


Replies

stingraycharleslast Sunday at 3:42 PM

My point is that it’s better that the model asks questions to better understand what’s going on before pushing back.

show 1 reply