Tesla, in particular, has given those skeptics so much ammunition to be mad at. The delay isn't purely due to luddites but also somewhat driven by prior obvious bad actions by self-driving car companies.

It's also likely that if a switchover is aggressively pursued it'll cause a massive social backlash and likely evolve into a culture war issue.