If there is reduced demand for new housing due to increased inventory, there's less of a demand on construction for new housing. The expenses involved in new builds is both labor and building codes/restrictions - construction firms undercut Americans by hiring foreign labor that they can pay under the table.
I would much prefer Americans pay a premium for skilled American labor and choose to live in more modestly-sized homes.