Humans haven't interacted with computers by typing in "5 columns right, 3 columns down" since before I was born. They use a mouse and keyboard.

Meanwhile AI agents are expected to guess pixels and fail each time.