alt Hacker NewsRAG, llm pipeline industry just continues in the same fashion of throwing even more glue, insanely slow, expensive, but works due to somehow companies having money to waste, perpetually. Not that much different from the whole Apache stack or similar gluey expensive and slow software.
There is similar mindless glue in all tech stacks. LLMs are trained on it, and successfully do more of it.
Even AI companies just wastefully do massive experiments with suboptimal data and compute bandwidth.
Yeah this is what kills me. Most of the problems we solve are pretty simple. We just made the stacks really painful and now LLMs look sensible because they are trained to reproduce that same old crap mindlessly.
What the hell are we really doing?
What looked sensible to me is designing a table, form and report in Microsoft Access in 30 minutes without requiring 5 engineers and writing 50k lines of React and fucking around with kubernetes and microservices to get there.
LLMs just paste over the pile of shit we build on.