This has been the game of capital since the 1700s. What's new with AI is actually a novel apex of irrationality, wherein the efficiency and profitability is being abandoned somewhat in favor of preservation and control over production (businesses are electing to sacrifice efficient deterministic modes of analysis in favor of less reliable stochastic approaches just because these technologies will allow them to continue to divest the laboring masses of any power over capital)
That can be fixed with more capitalism, for example there is a business opportunity right there:
> Why, when the restaurant is busy and crying out for couriers, does the app say there are none available?
Let the restaurant know they can call you.
The true paperclip problem is done with human hands, enslaved by the efficiency algorithm holding Damocles.