logoalt Hacker News

cyanydeezyesterday at 10:52 PM0 repliesview on HN

whats going on is openai and anthropic have tons of garbage in their system prompts "don't talk about goblins" so your ability to override that garbage is nearly wiped out. This is "alignment" and I'm pretty sure both orgs have convinced themselves that this benefits the customer.