I think we use the wrong term here - it's not progress, because progress in my mind means that we are working towards a goal and that goal gets closer. And I think humanity, or the universe for that matter don't have a well defined goal. Change however IS inevitable and these technologies represent change. There are always winners and losers when something's changing. As Max Tegmark puts it, this is the work of Moloch - everyone knows it's bad on a certain level, yet everyone has to play along, or their losses will be even greater.
Of course change is inevitable, but the specific changes aren't. This is just how immoral people justify themselves; someone was gonna do it so it might as well be me!
Of course there is a goal we're all working towards, and that goal is efficiency. For some reason or the other we collectively made striving for efficiency our ultimate end goal, and that's what 'progress' actually means. From this perspective replacing all human labor with AI actually 'makes sense'.