Apple Core AI Framework

This is why the AI companies are rushing to IPO. By the end of next year you’ll be running most of your AI on device. They have no moat, they’ve reached the limits of scaling, most of the magic can be distilled into smaller models, and they know it

i am more excited about the ondevice foundation model update that is coming https://developer.apple.com/documentation/updates/foundation... (not much info yet)

but i maintain https://github.com/Arthur-Ficial/apfel so i might be biased

WWDC 2026 Core AI videos

Meet Core AI - https://developer.apple.com/videos/play/wwdc2026/324/

Dive into Core AI model authoring and optimization - https://developer.apple.com/videos/play/wwdc2026/325/

Integrate on-device AI models into your app using Core AI - https://developer.apple.com/videos/play/wwdc2026/326/

Wow, this seems to be a new way to convert PyTorch models to a format that runs across CPU, GPU & Apple's Neural Engine (ANE). [0]

Does this completely replace the previous API, CoreML? [1]

  [0]: https://apple.github.io/coreai-optimization/
  [1]: https://developer.apple.com/documentation/coreml/

Is there something like this on Linux? For example, if I’m an application developer can I assume GNU Core AI (or whatever it is or would be called) will be there if the kernel is >= some particular version?