Because if the will of the people is for person A to serve in office X, then the will of the people should be absolute. I'd even allow election of minors and other currently non-eligible persons.

The only requirement should be that you are politically member of the given area, which typically means you actually physically live in the city/state/country.

Note, in Switzerland, you can already be voted into office _against your will_. And then you MUST serve. And this has actually happened in recent past, in remote villages to be fair.