A lot of people are missing that Google is light years ahead in terms of edge AI. They've been going on about it even before the GPT-craze. Pixel phones have had live captions (on edge transcriber) for a while.
Apple ships iPhones with their neural engine since 2017.
How good is their offline (on-device) ai offering?