logoalt Hacker News

robotswantdatatoday at 10:57 AM1 replyview on HN

Why are you using Ollama? Just use llama.cpp

brew install llama.cpp

use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app


Replies

Bigsytoday at 11:49 AM

For MLX I'd guess.

show 2 replies