logoalt Hacker News

ffsm8yesterday at 1:04 PM1 replyview on HN

> I don't think it does, but llama.cpp does

I just checked their docs and can't see anything like it.

Did you mistake the command to just download and load the model?


Replies

u8080yesterday at 1:47 PM

-hf ModelName:Q4_K_M

show 1 reply