> If I'm selling to the wealthiest zip code, where the median house price is over $10M, should I be disallowed to charge higher prices?

Yes, you should be disallowed. Otherwise every online store will upcharge you based on IP. There can be exceptions for small businesses or individuals, but that's it.