Nailed it. The amount of bandwidth men should dedicate to this is far lower than what women should be dedicating to it in terms of absolute risk.

That isn't to say you should not be thinking about making sure you don't put yourself in a situation where you could be falsely accused of something. I would say, if you are thinking in that way - spending some time making sure you don't do anything to make women uncomfortable is a good way to spend some of that energy as well - same goal, different thought process.