Incremental Snapshots PoC

[rezabaram]

Why

We aim to provide incremental Cardano DB snapshots to allow clients to download and verify only the parts they are missing or interested in. This will make our current solution more useful by enabling users to download only the immutable files they lack, along with the relevant ledger state. For instance, a full node wallet user could sync their node in minutes or even seconds using Mithril.

What

Implement a new type of Mithril certified data which enables the retrieval and verification of a range of immutable files.

How

• Create new signed entity type for Incremental Cardano DB #2121
• Implement signable builder for Incremental Cardano DB #2122
• Implement artifacts builder for Incremental Cardano DB #2151
• Implement artifact routes for Incremental Cardano DB in aggregator REST API #2152
• Implement digests route for Incremental Cardano DB in aggregator REST API
• Implement Incremental Cardano DB in client library
• Implement Incremental Cardano DB in client CLI
• Implement Incremental Cardano DB in WASM client (artifacts only)
• Implement monitoring and dashboarding
• Update explorer for Incremental Cardano DB
• Document Incremental Cardano DB

Later

• PoC BitTorrent archives storage
• PoC IPFS archives storage
• Support archives evolutive source selection and fallback mechanism (and monitoring)