Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: use binary diff to persist finalized states #7005

Open
wants to merge 42 commits into
base: feature/differential-archive
Choose a base branch
from
Open

feat: use binary diff to persist finalized states #7005

wants to merge 42 commits into from
+2,375 −454

Commits on Sep 12, 2024

  1. Add binary diff codec

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7e89c60 View commit details
    Browse the repository at this point in the history

  2. Add snapshot strategy

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    865212f View commit details
    Browse the repository at this point in the history

  3. Rename the utils file

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    db6ba48 View commit details
    Browse the repository at this point in the history

  4. Add diff strategy

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    321c16b View commit details
    Browse the repository at this point in the history

  5. Rename historical sate util file

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c9a12a5 View commit details
    Browse the repository at this point in the history

  6. Add skipped slot historical state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    f33926c View commit details
    Browse the repository at this point in the history

  7. Add worker support

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    888853e View commit details
    Browse the repository at this point in the history

  8. Update the archiver

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c6e5429 View commit details
    Browse the repository at this point in the history

  9. Fix the types

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0a9a262 View commit details
    Browse the repository at this point in the history

  10. Add vcdiff package

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    dd8d8b2 View commit details
    Browse the repository at this point in the history

  11. Add unit tests for multiple diff

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1827f39 View commit details
    Browse the repository at this point in the history

  12. Add diff state tests

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    b7902ce View commit details
    Browse the repository at this point in the history

  13. Add support to fetch last db state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    9f808fa View commit details
    Browse the repository at this point in the history

  14. Disable storing anchor state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    871a2b2 View commit details
    Browse the repository at this point in the history

  15. Extract historical state metrics

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    481e11c View commit details
    Browse the repository at this point in the history

  16. Update metrics usage

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6df2a49 View commit details
    Browse the repository at this point in the history

  17. Add diff and snapshot size metrics

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e46db7b View commit details
    Browse the repository at this point in the history

  18. Add doc for historical state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    448e5b8 View commit details
    Browse the repository at this point in the history

  19. Rename skip strategy to block replay

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d152046 View commit details
    Browse the repository at this point in the history

  20. Add diff layer configurations

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    89d8349 View commit details
    Browse the repository at this point in the history

  21. Implement the state diff layers

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1c877e2 View commit details
    Browse the repository at this point in the history

  22. Use diff layers

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    60026f4 View commit details
    Browse the repository at this point in the history

  23. Remove the obsolete stateArchiveEpochFrequency option

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d7cdb29 View commit details
    Browse the repository at this point in the history

  24. Rename stateArchive to stateSnapshotArchive

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    268eb29 View commit details
    Browse the repository at this point in the history

  25. Split state snapshot and diff archives

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1f6293d View commit details
    Browse the repository at this point in the history

  26. Use state diff repository

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0f48b51 View commit details
    Browse the repository at this point in the history

  27. Use historical regen object

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    abeb1c6 View commit details
    Browse the repository at this point in the history

  28. Fix lint errors

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1c2a2bb View commit details
    Browse the repository at this point in the history

  29. Refactored per suggested feedback

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4cfb002 View commit details
    Browse the repository at this point in the history

  30. Add documentation details with more explanation

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    2b010a9 View commit details
    Browse the repository at this point in the history

  31. Add logs to historical state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ec14a6d View commit details
    Browse the repository at this point in the history

  32. Add perf tests and few analysis about the defaults

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    bf67d1e View commit details
    Browse the repository at this point in the history

  33. Add unit tests for diffs

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1bc8edd View commit details
    Browse the repository at this point in the history

  34. Remove docs from this PR

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    b00f8b1 View commit details
    Browse the repository at this point in the history

  35. Change the defaul options for the diff layers

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    74925b4 View commit details
    Browse the repository at this point in the history

  36. Rename an attribute

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d60857e View commit details
    Browse the repository at this point in the history

  37. Fix some code after rebase

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    bad4039 View commit details
    Browse the repository at this point in the history

  38. Add dashbaord for hisotical state

    @nazarhussain
    nazarhussain committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    85262c7 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Add more logging

    @nazarhussain
    nazarhussain committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4480a26 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Add unit tests for last stored state

    @nazarhussain
    nazarhussain committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    e34caa3 View commit details
    Browse the repository at this point in the history

  2. Change default value for diff layers

    @nazarhussain
    nazarhussain committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    bc88c4a View commit details
    Browse the repository at this point in the history

  3. Add more logging for debugging

    @nazarhussain
    nazarhussain committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7eb7c17 View commit details
    Browse the repository at this point in the history