Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add IncrementalPersistence method to Segment interface & decouple from compaction #43

Open
hisundar opened this issue Jul 14, 2017 · 1 comment

Comments

@hisundar
Copy link
Contributor

Currently moss store compactions only work for the Basic segment kind since it uses a custom bufferedSectionWriter. Adding an incremental persistence method to the Segment interface will help decouple the compaction logic from the actual implementation of the Segment interface.
This can make moss much more extensible with custom segment types which support unique application needs such as - btrees for faster indexing, compressed segments for smaller file sizes, finite state transducers, bloom filters, etc

@hisundar
Copy link
Contributor Author

IncrementalPersistence must be a core requirement of any implementation of the Segment interface because it is a fundamental pre-requisite during the merge phase of the Log Structured Merge paradigm. The current bufferedSectionWriter can become the default implementation of this IncrementalPersister interface.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant