logoalt Hacker News

matheusmoreiratoday at 3:32 AM2 repliesview on HN

Indeed. If Apple makes it feasible to run models like GLM 5.2 at home, I will become their customer.


Replies

Abishek_Muthiantoday at 4:00 AM

It's plausible but is the Apple Tax for a 1TB memory machine on top of current memory prices really worth it? I paid around $4000 for 4090m laptop with 16GB VRAM back in 2023, it's great but DoA for even quantized LLMs. I can run SLMs and fine tune it but that's it.

We need one of those specialized inference chip startups to succeed and a PC manufacturer willing to bet on them against Nvidia for the local AI to find mass market appeal.

show 4 replies
jerontoday at 3:47 AM

you're not a customer of any of their products at all already? not a single apple device in your household?

show 8 replies