For what human leverage of AGI may look like, look at the relationship between a mother and a toddler.

As you said: There's an infinite number of things a toddler may find worth doing, and they offload most of the execution to the mother. The mother doesn't escape the ambiguity, but has more experience and context.

Of course, this all assumes AGI is coming and super intelligent.