logoalt Hacker News

SpicyLemonZest • today at 1:55 PM • 0 replies • view on HN

What “alignment” refers to is the ability to robustly convince a model to achieve anyone’s goals. This is really quite obvious and nearly everyone intuitively recognizes it; you use the word “aligned” this way yourself!

The source of the debate is that some people have a strong preconception that alignment can’t be a hard problem. GGP takes it for granted that alignment is solved and anyone who wants to can build a system that won’t cause harm. So picking a new word won’t help.