What GP describes sounds to me like having a friend control the computer and dictate to them what to do.

No matter how capable the friend it, it's oftentimes easier to do a task directly in a UI rather than to have to verbalize it to someone else.