logoalt Hacker News

DiabloD3today at 12:49 PM2 repliesview on HN

I don't think it does, but llama.cpp does, and can load models off HuggingFace directly (so, not limited to ollama's unofficial model mirror like ollama is).

There is no reason to ever use ollama.


Replies

ffsm8today at 1:04 PM

> I don't think it does, but llama.cpp does

I just checked their docs and can't see anything like it.

Did you mistake the command to just download and load the model?

show 1 reply
beanjuiceIItoday at 1:13 PM

sure there's a reason...it works fine thats the reason