logoalt Hacker News

yakkomajuriyesterday at 6:47 PM1 replyview on HN

hey, author (not op) here. we do do semantic chunking! I think maybe I gave the impression that we don't because of the mention of aggregating context but I tested this with questions that would require aggregating context from 15+ documents (meaning 2x that in chunks), hence the comment in the post!


Replies

mips_avataryesterday at 7:15 PM

Ah so you’re generating context from multiple docs for your chunks? How do you decide which docs get aggregated?

show 1 reply