Well one concern could be something like - ride share companies already extracted a lot of the profit share of local taxi companies out of their local economies and moved it to Silicon Valley. But at least there were local jobs so a good amount of money stayed in the local economy.

Now with driverless all the money leaves the local economy to go to Silicon Valley. And then what human labor is required is then offshored.