Average voters don't understand much about the economy, but that doesn't mean they aren't reacting to externalities like housing costs, prices, or other worse outcomes.