logoalt Hacker News

rvz • yesterday at 5:35 PM • 0 replies • view on HN

> It also helps combat the "LLMs ArE nOt DeTeRmInIsTiC" complaints.

Reality says otherwise, especially from those who run LLMs in production at a large scale. Hacks such as baking in the weights with tiny experiments doesn't disprove anything.

The same LLM boosters also continue to repeat one of the biggest misconceptions: "sEt TeMperaTurE tO zERo tO aChiEvE fUlL dEterMinIsm."