alt Hacker Newsas a recovering RAG-enthusiast, I will share a quote from a peer that has really stuck with me:
"why not use grep?"
Replies
goldenarm • today at 6:32 PM
Grep is the fastest tool for many things, but for production RAG it cannot search with meaning, different languages or typos like hybrid vector search can. And it won't scale on terabytes of documents across distributed servers if you want to say under 1000ms.
➕ show 3 replies
Grep is not semantic like embeddings, although the llm can expand a concept into multiple literal searches with a similar effect.