logoalt Hacker News

bluefirebrandtoday at 6:24 PM1 replyview on HN

I wonder if there's also less of a stigma and sense of wrongdoing about tricking an LLM versus tricking an employee

We intuitively know that an employee will be punished and may get fired if we trick them. Many of us won't try to trick human employees as a result, because we would feel bad if they had bad consequences as a result of our trickery

There is likely no such hesitation around tricking LLMs. I know I personally wouldn't feel bad about it at all. Mostly because any computerized customer service process is annoying so anything I can do to limit my time dealing with it is a win in my books


Replies

solid_fueltoday at 10:15 PM

I have no moral qualms about tricking an LLM, but I would not be surprised if it gets called a violation of the CFAA in the near future.