Introducing Core AI
Apple launches Core AI framework for on-device model inference across iOS and macOS.
Apple introduced Core AI, a new OS-level framework enabling developers to run AI models directly on device with a Swift API, supporting everything from compact vision models on iPhone to multi-billion parameter LLMs on Mac. The framework includes fine-grained memory management, model specialization, and custom GPU kernel support. This signals Apple's serious push to make on-device AI a first-class developer primitive, competing with cloud inference for latency-sensitive and privacy-focused use cases.