Im saying temperature is a hack to make the models actually produce real answers.
But they can get also real answers even if you have the temperature setting as 0, where it will always pick the highest scoring token?
alt Hacker News
But they can get also real answers even if you have the temperature setting as 0, where it will always pick the highest scoring token?