logoalt Hacker News

smcleodyesterday at 10:50 PM2 repliesview on HN

I suspect Ollama is at least partly moving away open source as they look to raise capitol, when they released their replacement desktop app they did so as closed source. You're absolutely right that people should be using llama.cpp - not only is it truly open source but it's significantly faster, has better model support, many more features, better maintained and the development community is far more active.


Replies

calgootoday at 10:09 AM

Only issue I have found with llama.cpp is trying to get it working with my amd GPU. Ollama almost works out of the box, in docker and directly on my Linux box.

parthsareentoday at 5:09 AM

Desktop app is open-source now.