Yes, this is the big one for me. Seemingly unlike a lot of folks, Plex is my main music server. Years ago I ripped all my CDs (1800+, IIRC) and Plex + Plexamp is really, really, really good for listening. I haven't yet found anything else that works as well.
I use Plexamp on desktop/laptop computers and then the Android and iOS apps for on-the-go music. I tried Symfonium [1] because it seemed promising and would give me a Jellyfin path, but it was weird and kinda buggy and ate my phone's battery.
I'm hopeful there'll be a good replacement available eventually, but for now, I just have to stick with Plex.
Yeah PlexAmp is amazing. Feels like it's the only music client around these days that has a functional "shuffle by album" option, instead of treating my library as only a collection of individual songs.
yeah I'm in a boat of similar shape. plex and plexamp is very simple and plug and play - it handles the IP stuff for remote play, which is the tough part for me.
I don't mind lacking features in the server or the client honestly, if I can find and play an album or playlist I'm good. But the connectivity piece can be hard if you're not familiar with self host stuff. I tried to do Jellyfin and Tailscale and some client and it... kind of worked? But it was definitely not as seamless.
I do hope every year that it's my last year paying for Plex. Maybe this year!
I use (and contribute to) Finamp the Jellyfin PlexAmp alternative and it's just done a 1.0.0 release which brings it up to parity with PlexAmp for me. I've previously been a long time PlexAmp user but FinAmp now does everything I want it to.