>Are those excess returns not work? What are they?

Normally you'd get a low percentage fee instead of getting all of the returns unless you got that capital for free (inheritance?), so yes, you are a worker compared to the person controlling the capital.