But, will they even realize when/where they're being surveilled?

Out of sight, out of mind. If there isn't a large video camera tracking them as they move across a shop or down the street, I'm not sure many people will even notice.