logoalt Hacker News

Der_Einzigetoday at 4:14 AM3 repliesview on HN

You got baited by bad sampling settings.

It's exactly the opposite. Go turn on min_p once it's available post July 27th and most of the problems you describe will go away.


Replies

nltoday at 5:43 AM

> Go turn on min_p once it's available post July 27th and most of the problems you describe will go away.

This seems both arrogantly dismissive ("you are holding it wrong") and incorrect.

Either the OP is using Kimi K3 on Moonshot where is is presumable set correctly (K3 isn't available elsewhere yet), or they are using Kimi K2.x and there has been plenty of time to experiment with this.

show 2 replies
dev_hugepagestoday at 7:23 AM

What parameter would you advise for min_p?

show 1 reply
carterschonwaldtoday at 4:22 AM

i've had trouble finding any anecdotes or data about how to actually set/explore logit sampler settings