I would argue that LLMs are still magic, because, unlike the rest of this list, we still don't actually know how exactly they do what they do. We know how to build and train them, and we have general ideas about why e.g. attention is important, but if we actually knew how they tick we could do the same thing in a much smaller package (by handcoding everything).