That's actually not NIMBY behavior at all, because you moved rather than trying to control everybody else around you!

It's great to want to be around few people, that's a choice that should be respected. Just as there should be a choice to allow people to associate at higher densities. But in practice, the law only works against one of these choices.