Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create the write ahead log & index manager #11

Open
dgrnbrg opened this issue May 8, 2016 · 0 comments
Open

Create the write ahead log & index manager #11

dgrnbrg opened this issue May 8, 2016 · 0 comments
Milestone

Comments

@dgrnbrg
Copy link
Collaborator

dgrnbrg commented May 8, 2016

A datomic database has the log of transactions plus 4 indices: :eavt, :aevt, :avet, and :vaet. We need to implement the module which takes a transaction (i.e. set of datoms) and does the following:

  1. adds them to the log
  2. adds them to the indices

In the background, the module needs to flush the indices when enough data is accumulated for the batch. We'll need to store the # of total transactions in the log, as well as the # of transactions durably added to each index, so that we can implement crash recovery.

The log should support pluggable implementations, so that today we could use a file or simple DB scheme, but in the future use Kafka or Redis.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant