Yeah, I often have military flight training over my town, and I don't find the sonic booms particularly bad. I barely notice the planes unless they fly close to the ground over my house.
I'm not sure how the sonic booms of fighter jets compare to passenger planes, though.
I can't stand military jets over my neighborhood. I get irrationally angry every time I'm walking somewhere with my wife and we both have to completely stop talking for two blocks because some F-14 is blasting around over our heads. They are just unbelievably loud.