> Just like with mathematicians, is it all really just about people losing a random, replaceable job and what they enjoyed about it?

For me it's about losing much of the entire career, because companies will come to expect AI-level work that I can't/won't provide.

> Being able to program means in particular, you can read those programs and understand what they do.

IMO This assumes that one views programming as more than just a job/career, but not everyone does so.

> Living in a reality where everything is a black box, doing its thing as if by magic, leaves you in a position devoid of control.

For some, this is actually relieving. Sometimes we want to be more ignorant, sometimes it makes us happier.