Well over half of Americans are living in Urban areas so median here is a measure of urban home prices.
Further average home prices reflects overall economic gains. The top 10%, 1%, 0.1%, etc getting richer buy nicer stuff driving up the average but that says little about overall affordability.