logoalt Hacker News

nfw2 • yesterday at 10:16 PM • 2 replies • view on HN

After working with a few people with what I can only describe as "AI psychosis", it seems to me that even excellent frontier models are pretty quickly lobotomized if sycophancy is rewarded and builds up in context.

I don't know if I would call resisting this a skill, but it does take persistent intention and willingness.


Replies

jgord • yesterday at 10:38 PM

Can you describe the symptoms of the AI psychosis youve observed ?

Yeah, considering how hard it is to food-diet or social-media-diet .. I think it requires immense resolve to LLM-diet or use it in a non-binge way that develops ones own depth of understanding.

Its going to require just far too much mental energy to push back against an LLM that is correct 92% of the time.

edit : removed air quotes around AI psychosis.. that might have read as sarcasm, which was not intended

➕ show 2 replies
gedy • yesterday at 11:14 PM

This is absolutely the case in my company. The CTO is rabidly pro-AI and single-handedly trying to rewrite our SaaS company system. Hearing the "no human can understand this", "my agents are better than hiring developers", etc type talk. Months of work. No limits on tokens for him.

When you look at the new system? It's the same damn thing company has now, with ill chosen tech stack for the domain, same blind spots that the system now has, weird API, etc. I guess the CSS is cleaner?

Call me unimpressed if this is the best agentic frontier models can do.