I know two people who have been pulled over in the US for driving too slow.

If you drive significantly slower than the flow of traffic it can create a hazard for other drivers.

Generally speaking, much of driving is predicting what other drivers will do. If you behave significantly differently than other cars you do raise the chances of an accident.