I wonder how common this set-up is, but it's what I settled on as well (my flake contains 8 other NixOS hosts with common home-manager config).

Sometimes I wish I could control more things using nix-darwin but then I remember I like mostly defaults on System Settings.