Obligatory "The Conspiracy Against High Temperature Sampling":
https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...
wow I wish I knew this post before I installed various UIs with tons of temp/top-X sliders.
They are extremely confusing.
where can one learn what top_k and top_p mean?
wow I wish I knew this post before I installed various UIs with tons of temp/top-X sliders.
They are extremely confusing.