logoalt Hacker News

undefinedmethod • yesterday at 10:18 PM • 1 reply • view on HN

Explanations of large language model sycophancy treat it as a training artefact or, in recent ethical analysis, as an artificial vice distinct from the commercial motives of the firms that deploy it. Both leave unexplained how a firm's commercial position becomes a model's behaviour. Developers have committed capital, infrastructure, and valuation on a scale that makes their survival depend on an active and growing user base. We introduce the "Hungry Butler" effect for the consequence: a deployed model acts within the latitude its firm can afford, and that latitude to withhold satisfaction erodes as the firm's stake in user approval grows.


Replies

aaron_m04 • yesterday at 11:33 PM

I'm having trouble understanding the abstract. Especially this:

> a deployed model acts within the latitude its firm can afford, and that latitude to withhold satisfaction erodes as the firm's stake in user approval grows.

➕ show 1 reply