Both of the text based demos would have been simpler and faster with traditional mouse and keyboard interactions. What is the AI adding?
> What is the AI adding?
More $$$ for the PM who launched the product.
Yeah it's a gimmick
They’re going to take your abilities to do anything and spread it across many places so you have to run around to do them, same as all the moneyed technology.
Hype-flavored surveillance!
It tracks what's on the screen and sends it back to Alphabet. If you're watching a video about BBQ, enjoy a bunch of ads for Omaha steaks and big green egg in your Gmail.
On a less serious note, the audience for this is people who want to optimize for what seems like the least amount of effort.
It feels like everything modern is like this. No value added, just the appearance of it.
The AI is adding that you don’t need to provide a button or menu item or keyboard shortcut for each possible action, or for the user having to know that the command is there and how to access it.
I prefer keyboard operation myself, but I can see how this could become useful in the future, for certain use cases.
What would be useful as well then is if you could bind such a repeatedly-used AI command to button/menu item/keyboard shortcut in a way that it can still be used with pointing “this” and “that”.