I'm about as far left as you can be, as a syndicalist anarchist, and I definitely perceived a bit of what you described. But I'm not super worried about it because he didn't say "the left", but rather a specific lefty position.

But also, the left isn't uniform on housing policy. Some folks want anti trust and limited capital ownership. Some folks want to de commodify housing. Some folks want all housing to be government built and owned. The left is a very diverse place (and the joke is no one hates leftists more than other leftists).