logoalt Hacker News

jtbaylyyesterday at 9:33 PM5 repliesview on HN

Any chance of running this nano model on my Mac?


Replies

mark_l_watsonyesterday at 11:30 PM

I used Nemotron 3 nana on LM Studio yesterday on my 32G M2-Pro mac mini. It is fast and passed all of my personal tool use tests, and did a good job analyzing code. Love it.

Today I ran a few simple cases on Ollama, but not much real testing.

axoltlyesterday at 10:49 PM

There's MLX versions of the model, so yes. LM Studio hasn't updated their mlx-lm runtime yet though, you'll get an exception.

But if you're OK running it without a UI wrapper, mlx_lm==0.30.0 will serve you fine.

show 1 reply
keyletoday at 3:54 AM

LMStudio and 32+ gb of RAM.

https://lmstudio.ai/models/nemotron-3

Simplest to just install it from the app.

netghostyesterday at 10:34 PM

Kind of depends on your mac, but if it's a relatively recent apple silicon model… maybe, probably?

> Nemotron 3 Nano is a 3.2B active (3.6B with embeddings) 31.6B total parameter model.

So I don't know the exact math once you have a MoE, but 3.2b will run on most anything, 31.6b and you're looking at needing a pretty large amount of ram.

show 1 reply
jonrosnertoday at 12:26 AM

running it on my M4 @ 90tps, takes 18GB of RAM.

show 2 replies