The issue is not that it's an LLM, the issue is that it's been RLHFed to hell to be a sycophant.