Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Be able to submit more than one experiment without waiting for the other to finish #14

Open
ClaireDons opened this issue Aug 2, 2024 · 2 comments

Comments

@ClaireDons
Copy link
Contributor

At the moment the workflow waits for each experiment to finish before submitting another. Would be nice to be able to submit one after another without waiting.

@ClaireDons
Copy link
Contributor Author

Possibly related, but snakemake exits with an error if the job times out.

@Peter9192
Copy link
Contributor

You could do that by removing the wait option from https://github.com/Urban-M4/misc/blob/eab22fde05dea647f0be0b1d993c2bb65c81baa0/workflows/snakemake/Snakefile#L174

But then you cannot do any other task after it that depends on it. Currently there's a 'cleanup workdir' task after WRF. If you don't wait, this will start right after the job submission. But perhaps we can make it a two-step workflow, that first runs up to WRF job submission, and you need to invoke a separate rule to do cleanup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants