alt Hacker NewsI actually think a desktop makes sense if you want to run local LLMs. I have an M4 Max laptop left to me when I got laid off. It can run good-sized LLMs, but the system heats up, the fans blast off, and it rips through the battery in under an hour. I'd rather have a desktop set up as a private inference server that I could connect to remotely.
Replies
pathartl • today at 4:41 PM
Bingo, desktops are still king for actual raw processing. Apple laptops are great, but they're still just computers, given proper cooling and power they can perform even better.
➕ show 1 reply
Desktop maybe, but Imac that costs more for the same specs of the mini you can shove in the drawer in a desk? I mean with the airspace taken up by an imac you only remotely connect to you could probably have two side by side stacks of I don't know, maybe 20 mac minis each? HPC territory.