The worst thing is that non-technical people, and actually a lot of technical people without experience in ML, will tend to overstimate the capabilities of those systems, neither the nuances of probabilitic thinking to properly integrate their outputs in a decision.

Remember that the polygraph still exists, now we will be dealing with a massive portion of the decision makers will treat as artificial inteligence not in the technical sense we use, but as real inteligence, maybe even super-inteligence.