Why shouldn't I? Your garden is not of a particular interest to me. It's just one of millions of gardens that I might look at as a part of scenery, or to get my bearings if I happen to be in the area. You'd be better off fighting street views in general, unless you are OK with the Streisand effect.