It 100% depends where you're at and the culture of that place, along with your perceived threat level.

People that are perceived as no threat or a 100% chance of being a deadly threat if ignored typically have no problems here. It's the grey zone where conflict shows up. Think of a little 60 year old grandma asking nicely the vast majority of people will listen. Same if you're a 6'7" slab of rock with tear drops tattooed on your face. Meanwhile if you're a minority asking a racist to turn down the volume, this situation is going to cause conflict almost all of the time.