This looks pretty promising to me. It will likely replace the need to set up OpenClaw for average personal users. The work of getting email, messages, and all the personal data on the phone as context seamlessly is not as straightforward as one might think.
I'm curious how the pricing will work. Would it be free up to some limit and then some subscription pricing? I can't imagine it can be free unlimited usage given the price of serving these models.
I doubt the average personal user knows what OpenClaw even is though Google is also producing competitive stuff.
This is why OpenAI thinks it needs to build its own physical devices. If Apple is only allowing its own AI to operate at the OS level, then that leaves OpenAI with no choice but to build their own.
Meta also realized this and attempted multiple times to build their own hardware but they've given up each time. They started as early as a partnering with HTC in 2011 to make a Facebook phone.
Quite frankly, I'm kind of excited to see what OpenAI can build. I think an AI-first phone could challenge iOS and Android. It's a new paradigm and if OpenAI gets it right, it'll be very hard for Apple and Google to pivot.
I personally think chat + code is the future of apps. For example, I find myself wanting to do many things inside ChatGPT instead of traditional app because I can tell it to do things that are simply impossible on a static app UI. For example, I have some data I want to send to an app but before I do, I want ChatGPT to clean the data in some way first. And then after the data is uploaded, I want ChatGPT to pull some data off the API and make charts that I want to see.
I imagine a world where very intelligent models run at 10k tokens/s, app building is extremely standardized, and it simply builds any app you want inside the OS. IE, if you want a dashboard of your health data, you ask it to build it almost instantly exactly how you want it. I'm already doing something similar today but it's slow and not easy to do for non-engineers.
Craig mentioned near the end of the keynote that compute intensive things (like image generation) will have rate limits that can be increased bundled with their iCloud + plans. I imagine any request that gets routed to their cloud compute will be subject to limits as well. He positioned it as a value-add to their existing subscription but I suppose that can change.