logoalt Hacker News

grey-areatoday at 9:42 AM3 repliesview on HN

I’m not talking about the em-dash, which is not a great indicator IMO but the horrible overuse of binary oppositions with a kind of false surprise, e.g.:

The problem was not em-dashes — but binary opposition!

That sort of thing.

It is a much clearer marker of llm use than the em-dash. The sad thing is when searching for info on this the most convincing reply in search was generated by an LLM, which went on at length about why LLMs do this as some sort of consequence of their internal structure. I have absolutely no idea if that’s true — it really sounds a bit trite and exactly the kind of thing LLMs would confidently assert with no basis. I would want to hear from someone working in LLMs, but their blogs are probably all generated by an LLM nowadays. So this conundrum is a good example of a question where LLMs actively work against clear resolution.

This is in my view the most insidious damage word generators are inflicting on our culture — we can no longer assume most writing is honest or well-meaning because amoral LLMs fundamentally are not wired to make that distinction of true and untrue or right and wrong (unlike most humans) and many people will use and trust what they generate without question, polluting the online space and training data until everything is just a morass of half-known facts sprinkled with generated falsehoods that are repeated so often they seem true.

How do we check sources when the sources themselves were generated by LLMs?


Replies

Macuyikotoday at 11:11 AM

My personal feel (completely subjective) is that during RLHF humans are incredibly sensitive to this pattern, especially when talking about personal or emotional issues. Any reply in the form of "it's not you, it's them" is such a dopamine hit that the LLMs started applying it for everything else.

show 1 reply
ghafftoday at 3:03 PM

The em-dash meme, if it's actually a thing, I find really annoying. That's the style in a lot of places and for a lot of people with or without spaces on either side. It was house style a a few different places I worked over about 25 years. More broadly, I assume LLMs are training on how a lot of people actually write. I'm not changing my writing style because some people will flag it as LLM-generated <shrug>.

msephtontoday at 10:23 AM

Apologies! You have a point.