In my experience, the same people who oppose building more housing also oppose vacancy taxes.