alt Hacker NewsApple arguably are making AI workstations that can do inference and training by their Mac Studio and Macbook Pros to a lesser extent. The M6 generation is going to be interesting and before the memory pricing going up their products were competitive to the rest of the industry. Intel is still working with small and smaller process nodes.
Yes, I want Apple to focus on Mac inference. It could be the return of laptops/desktops as a major revenue source for Apple. Macs have been ~10% of Apple's revenue for the last 10 years or so. I'd love to see Macs get up to 20-30%.
I do expect personal AI machines to take off in a few years once local models and local hardware hit an inflection point. M5 Max is a major improvement for local inference due to the added matmul accelerators, but the RAM capacity and bandwidth bottleneck is huge.
That said, enterprise AI chips will still take the cake in terms of margins.