Just have sane firewall rules and you are good. E.g. if I install openssh-server and it auto starts, it doesn't make it out of my machine because my nftables does not allow inbound on port 22. It's just knowing the default behaviour and adjusting your practices for it.
A sane firewall won't protect you from privilege escalation from a local attacker. While unlikely, this is one more breach that could be exploited.
This is the "you're holding it wrong" response to a clear design issue.
Aren't firewall rules part of the "configuration" the OP talked about?
That is a workaround for a ridiculous issue.