Hell, I (like anyone else) grab photos with my phone on vacation, and when I take a picture of a busy market, I do my best to avoid including people in my photographs.
People in places I visit are just trying to live their lives, they aren't some kind of human zoo for me.
Yeah, someone giving me even the slightest hint of being uncomfortable already makes me instantly delete their photo. Like, I want to photograph the public without ruining spontaneous moments, but I don't want to make others uncomfortable or mad at me because of my photographs.