In the early days it was pretty common to move the pointer to the active element when one started navigating with the keyboard.

But yeah, it feels like somebody physically grabbing your hand and moving it.