Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add batch submission feature #4

Open
vkuznet opened this issue Sep 7, 2023 · 0 comments
Open

Add batch submission feature #4

vkuznet opened this issue Sep 7, 2023 · 0 comments

Comments

@vkuznet
Copy link
Collaborator

vkuznet commented Sep 7, 2023

On main notebook interface I should remove Profile and add Batch button. Internally, I need another batch submission script to send CHAP to batch node. Follow CHESS batch page to see how to structure job submission.

We need the following steps:

  • create tarball of given workflow, i.e. we'll need to copy all workflow files along with yaml configurations
  • create another script for batch submission
  • the batch_submit.sh should call qsub command and copy necessary files to some area to unpack
  • need to decide how to deal with conda, therefore it may be I need to have proper conda environment in batch nodes or will need to create them dynamically
  • should fetch job ID and provide link to chap.log that user can find their batch job
@vkuznet vkuznet changed the title Add batch submission fewture Add batch submission feature Sep 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant