This has crossed my mind for other things too, like immigration.

People say they don't want immigrants because of crime (whether that's a reasonable concern is a different topic entirely), but it presupposes that laws against crime aren't enforced. If we had stricter law enforcement would people worry about (immigrants, the homeless, etc.) less?