I took a "Deep Learning" CS class in college back when it was in its early stages. I doubt the field is still called that now, but it was the subset of ML that has been rebranded as AI; includes LLMs, image generation, image recognition, etc.

Like any class, it was confusing at first, but when I eventually grasped the math behind what we were doing, and of course the visual representations of different elements to show lots of iterations of this math, it grounded the science for me, and I would hardly say people don't know what is going on. It only began to feel that way when it got a ton of hype and people jumping on the bandwagon who truly didn't understand it were trying to explain it to others, not to mention all the SOTA models put great effort into ensuring their methodologies stay trade secrets, going as far as effectively trying to ban people from learning the math by lobbying for the outlaw of open models.

Granted, "AI" has gotten way better than it was when I took that class, but the principles are the same, with different tooling and additional filters and algorithms thrown in there, as well as letting it determine the most appropriate statistically viable path forward for a particular prompt.

It's been this way for a long time, basically since deep learning became the "default" for ML. I remember back in 2018 taking a "Deep Learning" course and one of the most emphasized aspects of the approach is how much of a "black box" it is and how difficult (basically impossible at any non-trivial scale) it is to "understand" the outputs of a deep neural network compared to more classical methods like decisions trees or basic regression. This has only gotten more extreme as things have gotten more complex, abstract, and large.

That's pretty much a given when it comes to neural networks.