Under the hood, is this running shell commands (or Apple events) or is it actually clicking around in the UI?

If the latter, I'm a bit skeptical, as I haven't had great success with Claude's visual recognition. It regularly tells me there's nothing wrong with completely broken screenshots.