logoalt Hacker News

kaffekakatoday at 1:48 PM1 replyview on HN

A typical example is when discussing some issue where there is no clear right or wrong. Architectural decisions for example. Then it is easy to use an LLM to produce arguments for your opinion. It is also easy to do this without realizing it because you do not understand the issue enough yourself so you do not know what questions to ask or how the actual circumstances affect the choices.


Replies

zzzeektoday at 2:08 PM

well sure. I'm pretty sure if someone came to me with an architectural opinion in my field that an unknowledgable person got by coaxing an LLM into sycophancy, I'd be able to counter them effectively. if they are just refusing to listen then they're just a toxic person which is nothing new.

So I guess this all goes into the familiar "LLMs allow people who are shitty at <X> to produce 10x the shitty output". this is a failure mode we're going to have to learn to mitigate