And housing is a substitutable good.
The people moving into the new luxury units are moving out of older less desirable units, which (with enough of this movement) see their prices decline