Then change the fucking system so that people who have been living in a city for years can legally do so. Or kick them out. But don't have this vague system of sub-humans that are not allowed to influence their surroundings by voting.