It seems a bit silly to me that in many circumstances it's just way more acceptable for exercise to be zero part of your life than the reverse, and that an argument needs to be made for geting more than even 30 mins worth of movement in a week. A culture of getting exercise by default seems like the way things should be, and the should be an affordance for those who can't rather than a luxurious escape from not having to.
It's not as true in some places in some circles, but it's hard not to notice a difference when you temporarily visit the others.
I think you're right overall, but a lot of that is an unexamined reaction to a built environment designed for motor vehicles, rather than being designed for humans. In suburban America, it too often doesn't occur to people to walk even modest distances, and when they decide to try, the experience can be scary considering that they're likely to interact with inattentive truck/SUV drivers while crossing intersections. If I just crossed the major intersection on the way to work without being paranoid about vehicle traffic, I'd probably be wheelchair-bound by now.