I don't but RLHF probably does lead to this behaviour.
Is RLHF the best approach? It’s not how Steve Jobs designed the iPhone, famously. “Customers don’t know what they want” “A faster horse” etc…
alt Hacker News
Is RLHF the best approach? It’s not how Steve Jobs designed the iPhone, famously. “Customers don’t know what they want” “A faster horse” etc…