Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support rsync and/or aspera as an alternative download method #46

Open
kblin opened this issue Aug 17, 2017 · 2 comments
Open

Support rsync and/or aspera as an alternative download method #46

kblin opened this issue Aug 17, 2017 · 2 comments

Comments

@kblin
Copy link
Owner

kblin commented Aug 17, 2017

As described in some comments on issue #15, there is some interest in allowing downloads from NCBI to go via rsync or Aspera's ascp tool.

@andrewsanchez
Copy link

It seems like the solution here would be to have ncbigd generate some output that rsync or ascp can take as input. Probably less complicated and more flexible than calling rsync with subprocess.

@kblin
Copy link
Owner Author

kblin commented Jan 29, 2018

I don't know (or care much) about aspera, but I know that rsync supports an --include-from directive that I think just is a file of paths to grab. We could generate that, I guess.
That said, rsync will not be faster than what ncbi-genome-download can already do, or even slower if you can run parallel downloads, as rsync is single-threaded.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants