Why would they need our permission to take it? They can grab the seeds from anywhere on the planet, and they can just watch any farmer and/or forest for a couple of years and see how it works.

Of course this is putting aside any ideas of deciphering our books or tapping into the internet. Not much we'd be able to do to species that can travel the stars.