> embed everything the first time
This assumes your text is small. Try embedding pdf reports - though luck. It surely won’t fit into most embeddings. I can think of many more examples: books, news articles, medical reports, insurance claims etc. they’re all too big to “index it all at once”
you won't get anything out of a whole book embedding anyway, even a structured page is too much
What about splitting bigger content into chunks before embedding?