> therefore a lot of men who are annoyed at this visible signal that the woman doesn't want to listen to them

I mean I'm sure there's a guy somewhere who's annoyed by this, but "a lot of men who are annoyed" feels like making up a group of people to be angry at.