Sampling repeatedly gives them an estimate of the probability distribution in any case though.
That would be an interesting paper actually; what is the optimal sampling technique given you only have access to the token outputs. Surely someone has already done it.
alt Hacker News
That would be an interesting paper actually; what is the optimal sampling technique given you only have access to the token outputs. Surely someone has already done it.