Perhaps, but that is your tree, if someone takes a cutting from your tree and grows it into their own tree you shouldn't own that tree, your tree is still there.

Eventually you get to the point where someone asks why the tree is theirs and they say it's because someone in history planted it, they were a relative, so it is mine now. It is hard to assert a moral justification for long term hereditary ownership without inviting investigations on how it was those ancestors came to have the resources that caused the ownership to begin.