this is pretty different but reminds me of https://en.wikipedia.org/wiki/Bitcask - if you're storing it all in memory why not just use a hash index?

what this could really use is a compression format that compresses variable amount of text into fixed-size blocks. with that, it could binary-search compressed text