Apple has new Mac app coming to make running local AI models easy

Apple, to me, is the winner in the end of this AI chapter.

Distillation works: we can get models leaner, have better performance with lesser and lesser parameters, more efficient, running locally. Apple gets this and we'll see the result with M7 Max/ultra chips and I reckon this will be one of the titular apps when M7 line of chips are introduced.

I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.

But you’re still in for a ton of pain if you want to run them headless right?

They desperately need to fix that.

I love that they are bringing Claris back for this. Moof!

[dead]

Hopefully it won't be another preinstalled bloatware app like Image Playground. macOS enshittification has been greatly accelerating, even giving Win 11 Home a run for its money.