logoalt Hacker News

adrian_b • today at 11:58 AM • 1 reply • view on HN

Even if you cannot know what is in an open-weights LLM, so it may include malicious content, it is still infinitely safer to run yourself an open-weights LLM, regardless who made it, when you can control as finely as you want its actions and you can customize token probability sampling, than to subscribe to an LLM as a service provided by an external company.


Replies

utilize1808 • today at 12:40 PM

Easier said than done. Manipulating sampling probability is almost certainly detrimental to model performance.