Glasses’ camera [usually] sits right next to couple more cameras embedded in wearer’s skull. [Almost] nobody has any problem with those.
That strongly suggests me it’s not the cameras that are problematic, but something about what happens to the images.
I guess people wearing spy camera glasses won't do anything at all with the images! /s
Most people understand that the difference between your camera and your eyes is that one records an image, while the other records a very rough description of an image.