Don't forget that having lanes which are guaranteed to be congestion-free is useful to everyone, not just the rich.

If you're in SF and you get a call that your mother is in the hospital in SJ and it's 5pm, you would happily pay $100 in tolls to get there (I think the actual price is less than $20).

Unfortunately, there is no practical way to do this other than by charging money to use the fast lane, and this means that the rich will get more of the scarce resources than the poor.

This is no big deal - it's kind of a tautology, if you really think about it.