alt Hacker NewsHistorical precedent: Quickselect, or any other discovery of a surprising algorithmic speed-up.
LLMs haven’t been on the scene for very long. There’s still lots of room for efficiency discoveries. Plus, I keep hearing quantum is going to be a big deal in the next few years.
Super interesting, when Quantum computing would enable really large models, or much larger contexts. But QRAM is even more behind than pure fault-tolerant gates.