You do need to justify it. There is a great moral hazard prioritizing the driver's safety over pedestrians, since the driver is most in control of the danger. There is very little a pedestrian can do to protect themselves from a driver on their phone who mounts the sidewalk.
Fixing on the pedestrian safety yields higher death counts overall. It is justified in quantity.