People want to live in those areas because of the lower density. Remove that and they become much less desirable.