logoalt Hacker News

usernametaken29today at 10:45 AM2 repliesview on HN

> embed everything the first time

This assumes your text is small. Try embedding pdf reports - though luck. It surely won’t fit into most embeddings. I can think of many more examples: books, news articles, medical reports, insurance claims etc. they’re all too big to “index it all at once”


Replies

robrorcroptrertoday at 11:35 AM

What about splitting bigger content into chunks before embedding?

show 2 replies
khalictoday at 12:27 PM

you won't get anything out of a whole book embedding anyway, even a structured page is too much