logoalt Hacker News

hkchadyesterday at 7:09 PM3 repliesview on HN

I have a M5 MAX with 128, local models are toys compared to hosted ones. I've spent a lot of time and money trying to make it work even 1/2 as well.


Replies

dofmyesterday at 10:54 PM

It all depends on what you want to do, I guess.

If you're seeking the kind of hands-off claude experience, obviously not. They are slow.

If you want to learn how these things work, train them locally, tinker, play with the code, grasp the fundamentals, or just out of sheer bloody-mindedness and principle refuse to tether the functioning of your application to a cloud API...

iluvcommunismyesterday at 7:15 PM

[dead]