Lots of other efficiencies to look at. Tons of them are directly bad for the patient (capturing more of the surplus is an efficiency that businesses generally go hard at).
Ultimately, I think the issue is when people making decisions are able to treat the impact as an abstraction.