It is difficult to know whether going faster is overall safer. In my experience, some fraction of cars will pass a bicycle under any conditions, no matter what speed that bicycle is going (even if keeping up with traffic above the speed limit), no matter how dangerous it might be, no matter if the bicycle has "taken the lane" leaving no room to pass safely -- for some car drivers, it is about getting ahead of the bicycle.