On the other hand, if you're an Uber driver it is nice to know the person getting into your car was rated positively (not a dangerous individual, smelling of alcohol, etc.)

But I have actually no idea if drivers can say "no" based on ratings.

In general I would agree with you.