Compound growth is also the exact thing that is being criticized here. Your wealth grows simply by virtue of ownership. No labor needs to be performed. When somebody says that you can't earn a billion dollars they are the same thing that PG is saying, he just doesn't think it is bad: the way to become a billionaire is to own things whose value rises over time. The issue is whether this can be meaningfully called "earning" it.
Are you doing something to create that value? If yes, then I think you are earning it. If you are simply an investor, then no, but we need investors to make the whole system work.