alt Hacker NewsYes. There's no problem with choosing the same face every time. The problem is the probability it attached to the choice. Jev gave face 1 an 83% probability while the true probability is 1/6.
Replies
sshine • today at 4:22 PM
Do you provide Jev that the probability is 1/6 and yet it gives back a probability that is way off?
➕ show 1 reply
Okay, I see, you're expecting Jev to properly give 1/6 probability for each option. This is different from my intuition of how LLMs work, where their probabilities don't really work like this (I would expect LLM to also do something like 0.83 for 1).