Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve module specific resource requests #6629

Open
edmundmiller opened this issue Sep 11, 2024 · 4 comments
Open

Improve module specific resource requests #6629

edmundmiller opened this issue Sep 11, 2024 · 4 comments

Comments

@edmundmiller
Copy link
Contributor

Meta issue from #6628 for more discussion and dropping some resources.

We might need to do some benchmarking of the biggest bottleneck modules.

@edmundmiller
Copy link
Contributor Author

@SPPearce
Copy link
Contributor

Hmmm, I implemented the samtools sort memory setting in my in-house pipeline last week...

@edmundmiller
Copy link
Contributor Author

Two different ways we can handle these:

  1. Setting the memory dynamically for algorithm things. We can take a filesize/number of files/runtime requirement and calculate pretty close to the CPUs/memory. Set BWA and bwamem2 index memory dynamically #6628
  2. Point of diminishing returns with resourceLimits(users can take them off if they really want to). Limit Trimgalore to 15 cpus #7173

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

2 participants