logoalt Hacker News

StilesCrisisyesterday at 6:57 PM1 replyview on HN

If you ask an LLM, "what known example did you use to solve this?" it is very likely to cite something plausible-sounding. That absolutely doesn't mean it is what it actually did. It is trying to give the "right answer" and please.


Replies

fidotrontoday at 12:59 AM

> If you ask an LLM, "what known example did you use to solve this?" it is very likely to cite something plausible-sounding. That absolutely doesn't mean it is what it actually did. It is trying to give the "right answer" and please.

That's not what I said happened though. It didn't solve the problem (for weeks) until I (accidentally) told it which example it happened to know was relevant, and then it solved it in hours.