logoalt Hacker News

teraflop • today at 4:51 PM • 0 replies • view on HN

The difficulty with "alignment" is that you have to specify whose goals and values the model is supposed to be aligned with.

Maybe for you and me, this kind of behavior would count as misalignment. But there are certainly a subset people out there for whom the opposite is true. If they tell the agent "get me my refund by any means necessary", harassing bureaucrats and manufacturing excuses is exactly the behavior the want, because it's what they would do themselves if they had the time and patience.

Think about the kinds of people who will escalate petty grievances with their neighbors by weaponizing the police, HOAs, public opinion, etc. Or see this news article about a German tourist who visited NYC for a week and ended up filing three lawsuits, including one against a taco restaurant for having salsa that was too spicy, and one against Wal-Mart because he couldn't get their Wi-Fi to work:

https://www.nytimes.com/2026/03/14/nyregion/german-tourist-n...