The gradients are noisy as they are, this additional noise probably does not hurt that much overall