Most of that fear was driven by the response, not the attacks themselves. The government could have tried to calm the people down, but instead it amped them up and treated terrorism as the most dangerous thing imaginable. You can't say that the ridiculous over-the-top response was justifiable because people were terrified, when that is a big part of why people were terrified.