The people that think like this are the ones that want to pick and choose what is not other peoples problems.
It doesn't work or scale in a society. If everyone gets to arbitrarily choose what is 'not your problem', the everything is everyones problem, or nobody's problem.