logoalt Hacker News

bkotoday at 12:44 AM2 repliesview on HN

Can you reproduce irreproducibility?

Give me a question which the LLM answers vastly differently on runs.

I keep hearing how it's dumb and wrong but no one ever shares the chat or prompt


Replies

uxhackertoday at 12:54 AM

Try this with ChatGPT or GROK or Claude

How many days of the week contain the letter d?

The answer I get with ChatGPT, and Grok is 3 and 6 with Claude.

show 1 reply