As a dad of 3 I have huge respect for your 4 and I doubt there is much I can offer you in terms of information but I think I would have more complaints similar to yours had my wife not been a lot wiser and more proactive than me, so I'll share.

First is where you live. I would have picked based on access to nature and cost, she made us pick based on where other families live and proximity to family. In my town everyone is either actively parenting kids or had raised kids already, so the residents (and businesses) are super accommodating of families with kids. To the point where if I have to take a little one to the bathroom in a restaurant, people often invite my big one (5 year old) to hang out at their table so I don't have to worry about it.

Similar for social circle. Because everyone is my town is roughly dealing with the same things it's relatively easy to bond with new people. We've met people talking at the park, at t school drop off, while waiting at the martial arts place etc. Most people are nice if not super interesting but you meet enough people you like.

And living close to family (my wife's family in this case) means you have more network around etc.

Obviously it's not easy to just pick up and move but I am sharing this because the benefits of living in the right, family oriented, place would have been lost on me. Thank G-d my wife was wiser.