-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for non-local file storage with GA4GH TES driver #2
Comments
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
@pditommaso can we reopen this? |
Sure |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
@vsmalladi is testing this PR nextflow-io/nextflow#4195 with TES Azure, so if it works then it should fix this issue. |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Taking a look for azure. |
New feature
Currently, the GA4GH TES driver only support shared-file systems. Other distributed compute APIs, like the AWS batch driver, are able to manage object storage based non-shared file systems. The request is to bring the GA4GH TES driver up to speed with other Nextflow drivers.
Usage scenario
Using the GA4GH TES execution driver in a system where shared file system is not avalible.
Suggest implementation
Start with file copy pattern seen in:
https://github.com/nextflow-io/nextflow/blob/master/plugins/nf-amazon/src/main/nextflow/cloud/aws/batch/AwsBatchFileCopyStrategy.groovy
or
https://github.com/nextflow-io/nextflow/blob/master/plugins/nf-azure/src/main/nextflow/cloud/azure/file/AzBashLib.groovy
or
https://github.com/nextflow-io/nextflow/blob/master/plugins/nf-google/src/main/nextflow/cloud/google/lifesciences/GoogleLifeSciencesFileCopyStrategy.groovy
But because TES is able to manage different types of non-local storage systems, this should be configurable.
The text was updated successfully, but these errors were encountered: