I see this troll response all the time stating families don't want "poors" as some kind of attempt at manipulation to feel I am a bad person.

I [given the chance] would also vote against apartments in my particular neighborhood, and it has nothing to do with being poor at all.