logoalt Hacker News

cyanydeeztoday at 1:35 PM1 replyview on HN

Guys, LLMs are build on all these social cues which were developed pre-model. There's atleast 10 years of pre-llm gibberish.

This is to say: Marketers and spammers repeat the same things over and over, and these models are build on coalescing repetition into the basis.

So yeah, of course people talked like this before, but it was always in some known context like linked in or a spam website.


Replies

fwiptoday at 1:56 PM

Sure, but RLHF ended up emphasizing this to a level beyond normal human writing.