> landlords are rent seeking and nothing else

Noone says it's nothing else. But rent seeking is a big component of it, you just focus on other minor parts.

In general, locking down some limited but critical commodity (e.g. land) is bad for any economic system. It doesn't really matter whether it's "Wall Street" or "your neighbor". A healthy economy is geared towards creating an added value.