I grew up in a town outside of London (100k pop.) and it was pretty decent as I could walk pretty much everywhere.
I live in a massive city now (1.5m pop.) and I'd be nervous to let my kids walk around alone because there's quite a lot of crime.
I feel a town is probably the sweet spot.