logoalt Hacker News

LordFast • yesterday at 11:46 PM • 1 reply • view on HN

Eh, there's good and bad. The model mostly sticks to prevailing narratives in the training corpus. So if there is something that the prevailing narrative is really wrong about, it's gonna be just as pig-headed about it as a typical internet forum rando.


Replies

aldanor • today at 12:16 AM

Not entirely correct. This kind of fine-grained model behaviour is built in post training stages, RL, RLHF etc, where model receives rewards or penalties for talking (or not talking) a certain way

➕ show 1 reply