logoalt Hacker News

esafaklast Sunday at 2:12 PM5 repliesview on HN

For the purposes of running LLM models, a Mac Mini. The PC is cheaper, but it doesn't have MacOS, Apple's service or resale value.


Replies

jchwlast Sunday at 2:26 PM

Actually the pricing is pretty similar.

Framework Desktop price with default selections, 32GB of RAM, 500 GB storage: $1,242.00 USD

Mac Mini with 32GB of RAM, 512 GB storage: $1,199.00

Post changed a bit since I started replying, so:

> For the purposes of running LLM models, a Mac Mini

The M4 Max is the one that actually gives you a shit load of memory bandwidth. If you just get a normal M4 it's not going to be especially good at that.

> it doesn't have MacOS

The Mac can't run Windows, which is used by ~75% of all desktop computer users and the main operating system that video games target. I'd say that would be the bigger problem for many.

> Apple's service

What advantage does that get you over Framework's service?

> resale value

Framework resale value has proven to be excellent by the way. Go to eBay, search "Framework Laptop", go to "Sold Items". Many SKUs seem to be retaining most of their value.

(Nevermind the ease of repair for the Framework, or the superior expandability. If you want to expand the disk space on an M4 you need to get sketchy parts, possibly solder things, and rescue your Mac with another Mac. For framework devices you plug in another M.2 card.)

show 2 replies
pimeyslast Sunday at 3:04 PM

I count not needing to use macOS a big plus. Full Linux support out of the box.

croeslast Sunday at 4:44 PM

> but it doesn't have MacOS, Apple's service or resale value.

If the purpose is running LLMs non of that matters.

But Linux support is an advantage. Does the M4 have that?

show 1 reply
dismalaflast Sunday at 5:11 PM

The M4 has half the memory bandwidth of the 395+ and the specs on those models are absolute trash. To get an M4 Pro APU and decent specs you're spending at least as much as the Framework, at least here in Canada.