If something becomes a strong negative symbol, it's intelligent to recognize that because failing to do so can harm your goal, e.g. communication.

As an extreme example of this, no one calls it a "Charlie Chaplain moustache" and if you wear one people will avoid you, no matter how much you insist it's just because you like Charlie.