logoalt Hacker News

7402today at 6:08 PM3 repliesview on HN

I don't like it when the LLM tries to be my friend. My general prompt (a work in progress) is this. I wonder what other people use.

"Answer impersonally, objectively and analytically, without undue friendliness or enthusiasm. Use an engineering style response: concise, factual, and complete. Do not speak in the first person. Do not promote engagement or an emotional connection. Do not use emojis."


Replies

prymitivetoday at 6:21 PM

+1 it’s a tool

It’s not perfect, it has shortcomings, it sometimes produces bogus outputs. All of that is fine for a tool, it’s not fine when it pretends it’s a conscious being, because errors start to feel like lies and it becomes a bit too personal.

show 1 reply
doctoboggantoday at 7:38 PM

Yes, this really ought to be trained in (or at least RLHF'd in) but that would hurt engagement numbers so the opposite is done instead.

These are tools and it would behoove us all to keep that top of mind. Dangerous tools that are not your friend (but are useful as tools nonetheless)