While I probably prefer a society that is more "for the many", I can't exclude the possibility that some people have different preferences and would not want to impose my opinion.

Considering this, everybody might have to make (at some point in their lives) hard choices regarding where they choose to live. Yes, one should fight to improve the society one is living in, but there is also a saying "only the fool persists in their folly" ...