That math is very much general purpose. It's just linear algebra under the hood, and linear algebra is a wildly useful toolkit with an unbounded set of potential applications, including many applications other than LLMs. That's how something developed for gaming evolved into something used for text processing and generation. For example, we have barely begun to scratch the surface of what we can achieve with robotics, and I have no doubt that further advances in robotics will generate an enormous amount of computer vision work that GPUs are extremely well designed to handle.