The distinction matters. The cost (to my users) of switching from one Mumble server to another is the same, regardless of who hosts the server. The cost of switching from one "Discord server" to another is much lower than the cost of switching between Discord and any Discord clone, keeping people on Discord.
That's not some inherent feature of it being a server or not, that's a feature of Discord offering much more features than Mumble.