Lidar is incredibly low power and fast scanning, the retinal risk is probably much less than having to drive when the sun is near the horizon.
It's also typically at a wavelength that has lower risk to human eyes (ie near infrared).
Laser eye safety risk is very measurable and well classified.
However LIDAR safety is currently mostly evaluated on the assumption of a single LIDAR being present. If LIDAR becomes common, with multiple systems per vehicle, the probability of multiple LIDAR beams of different LIDARs hitting your eye at the same time goes up