alt Hacker News> But calling it "just software" is trivializing it in my opinion
The bigger mistake would be trivializing the rest of the technology involved just because LLMs are the newest piece. LLMs are only "magic" because they're built on a stack that was already "magic" without them.
LLMs are impossible without:
- operating systems
- programming languages
- compilers
- data centers / power grids / air conditioning
- servers / switches / routers
- CPUs / RAM / GPUs / SSDs
- fiber networks
- etc
I would argue that LLMs are still magic, because, unlike the rest of this list, we still don't actually know how exactly they do what they do. We know how to build and train them, and we have general ideas about why e.g. attention is important, but if we actually knew how they tick we could do the same thing in a much smaller package (by handcoding everything).