alt Hacker NewsThere is a reason no one uses Apple for local models. Be careful not to fall for marketing and fanboyism.
Just look at what people are actually using. Don't rely on a few people who tested a few short prompts with short completions.
There is a reason no one uses Apple for local models. Be careful not to fall for marketing and fanboyism.
Just look at what people are actually using. Don't rely on a few people who tested a few short prompts with short completions.
yes, I'm using smaller models on a Mac M2 Ultra 32GB and they work well, but larger models and coding use might be not a good fit for the architecture, after all.