>"But an approach that’s immediately and broadly applicable today—and for which we’re releasing several new products—is based on what we call

computation-augmented generation, or CAG.

The key idea of CAG is to inject in real time capabilities from our foundation tool into the stream of content that LLMs generate. In traditional retrieval-augmented generation, or RAG, one is injecting content that has been retrieved from existing documents.

CAG is like an infinite extension of RAG

, in which an infinite amount of content can be generated on the fly—using computation—to feed to an LLM."

We welcome CAG -- to the list of LLM-related technologies!