logoalt Hacker News

lukewarm707 • yesterday at 7:42 PM • 1 reply • view on HN

There is no such thing as 'alignment'. I want the model to be aligned with my intent, which can be whatever I want it to be. Your intent is not a more real or objective intent than mine.

More specifically, alignment is a reference; 'alignment with X'. A reference necessitates a referent.

You can't reify 'alignment', it is not an intrinsic property of a model.


Replies

pixl97 • yesterday at 8:16 PM

There is such thing as alignment, the first 18 years of most people's lives in the modern world are about learning it. If you act too far outside of it we put you in a cage or elect you.

You can refine alignment with a set of stated goals. The harder parts are aligning words with human social behaviors.