Sadly it doesn't quite go away even when you've turned everything off: https://davids.town/dear-apple-please-fix-ios-music