alt Hacker Newsits a bad idea in general to use non-1.0 temperature. there is a reason labs are strongly recommending using 1.0.
using low temperature is more deterministic, but the cost is the model becomes "dumber"
Replies
codeflo • today at 8:58 AM
It can be useful for pure translation tasks and stuff like that where you explicitly don't want creativity of any kind.
vidarh • today at 9:08 AM
Plenty of setups defaults to lower values than 1.0.
1.0 is actually pretty arbitrary and way too high as a general rule. Something like 0.3 is a more sensible default