Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a snapshot of the chain_data to speed up syncing #63

Open
MarcioMacedoBA opened this issue Jun 2, 2022 · 5 comments
Open

Use a snapshot of the chain_data to speed up syncing #63

MarcioMacedoBA opened this issue Jun 2, 2022 · 5 comments
Labels
enhancement New feature or request

Comments

@MarcioMacedoBA
Copy link
Contributor

MarcioMacedoBA commented Jun 2, 2022

Suggestion:

  • save a snapshot of the current chain_data of the mainnet and upload it to the server (that can be done manually, at first);
  • speed up the syncing of the mainnet for new users through the download of the aforementioned snapshot (that must be done automatically by the server);

That feature seems to be already implemented for v2 with a snapshot that dates back to April, 2021. It would be desirable to make this feature available for v3 too.

@johanneshahn
Copy link
Member

new function for Import chain snapshot and Export chain snapshot can be integrated into node, without rewrite the complete header/body sync process. The sharing of this chain snapshot can be then done by users directly or like on 51pool.online as a daily snapshot of chain folder.

This can be added as cli function and tui.

what you think @MarcioMacedoBA ?

@MarcioMacedoBA
Copy link
Contributor Author

Hi @johanneshahn!

Sorry for the late reply. That is really a good idea!

@FelipeMuylaert
Copy link

A CDN was used to make the file compacted and available worldwide, the snapshot is automatically and hourly generated. To those interested in using this feature following are detailed steps on how to use this, the file is available at (https://epiccash.s3.sa-east-1.amazonaws.com/mainnet.zip),

Step by step of the server installation with a CDN snapshot:

-Download the .zip with the chain snapshot from the link above;
-Install the server as per usual instructions;
-Start the server, let it run 1-2 minutes, and stop it;
-Go to .epic/main and clear all the contents;
-Unzip the snapshot directly inside on the main folder;
-Start the server and wait for the sync to finish;
-Continue the other steps as usual;

@johanneshahn
Copy link
Member

A CDN was used to make the file compacted and available worldwide, the snapshot is automatically and hourly generated. To those interested in using this feature following are detailed steps on how to use this, the file is available at (https://epiccash.s3.sa-east-1.amazonaws.com/mainnet.zip),

Step by step of the server installation with a CDN snapshot:

-Download the .zip with the chain snapshot from the link above; -Install the server as per usual instructions; -Start the server, let it run 1-2 minutes, and stop it; -Go to .epic/main and clear all the contents; -Unzip the snapshot directly inside on the main folder; -Start the server and wait for the sync to finish; -Continue the other steps as usual;

-Go to .epic/main and clear all the contents; ... i guess it should be .epic/main/chain_data/ ... or else you delete all server config or wallet data

@who-biz who-biz added the enhancement New feature or request label Jul 7, 2023
@who-biz
Copy link
Contributor

who-biz commented Jul 7, 2023

With our new skip_pow_validation work happening in https://github.com/who-biz/epic/tree/sync-research, I do not think this is necessary.

If this is still a desired feature, please let me know. Leaving open until we finish the sync speedup work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants
@johanneshahn @who-biz @MarcioMacedoBA @FelipeMuylaert and others