Partly true, though to a first approximation, the reason we don't build more houses isn't an issue of construction labor costs. Many places with jobs don't allow building homes.

(That's not inherently a universal problem, especially if you're talking about the entire labor market. But it's a problem in many places.)