You would still need a way to map the music to the person listening to it.

Apple and Google could do this if you use their music services, but they already know where you are.

I suppose if I have very unique taste in music and someone else knew about it, they could track me, but this is easily foiled by wearing headphones.