Sure, lets have the minority of the population force us into design choices that are detrimental to the majority of bus users.

When living in many a European city, I have chosen to walk instead of using a bus route due to the frequent stops making the bus trip a lot more expensive and marginally quicker. I have also lived in places where the eldery get a separate service, tailored to them, if they need it. Works a lot better IMO.