It's worrying because it reduces the incentive to build more housing.
You can also accomplish lower prices by building more. People dont want that so one could argue it is good to make them pay for what they want.
How do you quantify "incentive"? Is a landlord really looking at 5% lower property value and deciding it's not worth investing? Is this even true in aggregate?
Generally reduced construction results in higher real estate prices not lower prices. Proof: look at the well studied example of California.