logoalt Hacker News

DixieDevyesterday at 8:08 PM3 repliesview on HN

This line of thought works for storage in isolation, but does not hold up if write speed is a concern.


Replies

cannonpalmsyesterday at 9:20 PM

So long as (fast/optimal) real-time access to new data is not a concern, you can introduce compaction to solve both problems.

show 1 reply
convolvatronyesterday at 8:31 PM

as a line of thought, it totally does. you just extend the workload description to include writes. where this get problematic is that the ideal structure for transactional writes is nearly pessimal from a read standpoint. which is why we seem to end up doubling the write overhead - once to remember and once to optimize. or highly write-centric approach like LSM

I'd love to be clued in on more interesting architectures that either attempt to optimize both or provide a more continuous tuning knob between them