logoalt Hacker News

mring33621today at 2:09 PM1 replyview on HN

L O C A L M O D E L S

All data stays on computers that you control.

Same API. Localhost.


Replies

mring33621today at 2:28 PM

Try Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q4_k_m.gguf. This 7.5GB model runs well in llama.cpp on my 2021 Macbook Pro and is good at both coding and business document analysis tasks.

show 1 reply