Never going to happen. Yeah, we might get to a point where lots of people object to them in lots of places. But nobody allowing them anywhere? Mongolia wouldn't let you build in a little corner of the vast steppe? Algeria wouldn't let you plop down in a nice patch of unused Sahara?

The worst that would happen is that it becomes difficult to build in convenient places. That certainly would be annoying. But the problem with space as the solution is that space is by far the least convenient place imaginable, with the possible exception of the bottom of the deep ocean.