alt Hacker NewsI was thinking about making a "personal data search engine". I have almost 30GB of email archives and a bunch of Google Drive and offline files. I am thinking about downloading it all from the cloud and storing it on a large RAID array, with an indexing and search interface (and possibly a local MCP server).
Would Hister be suitable for this? Can it index mbox files? Would it handle this amount of data? Does it have a search API so I can build an MCP server?
> Would Hister be suitable for this?
The indexer it uses (Bleve) can handle millions of records according to their docs, but sure that Hister would be the best choice for this task. I'd probably use Meilisearch (https://www.meilisearch.com/).
> Can it index mbox files?
Not yet.
> Does it have a search API so I can build an MCP server?
It has both search API and MCP server endpoints.