alt Hacker NewsOther models can also be guilty of this.
One of my most vivid memories of a poor experience with an LLM was trying to get the web version of GPT 5.3 or 5.2 to help me figure out why I was unable to register for a tournament on start.gg
After trying several things it became apparent that the behavior could only be explained as the result of a bug with the start.gg site, chatgpt refused to consider that it could be anything other than user error on my part, despite the failure I was seeing making no logical sense.
Eventually I opened the firefox dev tools and noticed that the post request parameters to complete the registration were being incorrectly filled out and realized it was because of the metadata in the url that came from clicking the complete registration link I was emailed. Removing the url paramater added by the email link fixed the issue.
There was roughly a 0% chance that the LLM was going to trust me enough to consider it was a real bug.
Indeed, O3 and the early ChatGPT 5 thinking mode models were like this.
I stopped using ChatGPT for a while around this time and had a good experience using Claude exclusively, then I had to go back after Sol was released as Claude was driving me nuts.
I found that ChatGPT was greatly improved personality-wise from where it had been when I left, and now in my opinion is a better experience than the Claude models.
I’m really not trying to shill for OpenAI here, I’d much prefer to use Anthropic models if they were less annoying.