This is the right way to look at it. For autonomous fleets, there are typically tiers of intervention, starting with a simple remote check - "can I drive through this?" type confirmation, to much more detailed remote instructions that are slower to give, to getting someone from operations out (or in an emergency first responders) to manually move the car. One reason why you might want to keep traditional controls in the vehicle for the near term.
It's a big operations challenge, and hope Waymo (and everyone else TBH) get it smoother and smoother.