It might be that you’re the asshole in this situation. I think the boundaries are pourous around this topic.
(Sure, I just called someone random on the web an asshole. I don’t mean it with any force. In London we get people riding busses playing their im-personal stereos loudly, sometimes. I often don’t like it either. I often use headphones for my own sounds but not the blocking kind, and will have to stop my music because of thwirs. One time someone got into the Tube/metro carriage I was in playing loud Brazilian music from a speaker on a trolley. At first it annoyed me, but after a few bars it got me grooving. Then I realised it was a funk-infused cover of a traditional capoeira song, so I steuck up a conversation with the other rider about Brazil and capoeira. Made my day.)
That's nice you can get some nice story out of it but I do think people who grew up in cities have a totally different mindset than the rest of us.
For me, I don't want to live in a cacophony of noises 24/7. That goes for music, non-stop ambulances, loud speakers, etc.
I tried and decided that those places are not for me, so I moved back to smaller and much quieter places (I very much prefer the sound of rivers, insects and wild birds to other people's sounds.)
It might make me an asshole but it's also quite natural to be drawn to peace, so there that.
Realizing that you enjoyed being forced to listen to music you didn't decide to listen to doesn't mean you might be an asshole for not enjoying it at other times. That's ridiculous.