New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adaptive memory and disk requirement #216

Open

dachengx opened this issue Oct 15, 2024 · 0 comments

Contributor

dachengx commented Oct 15, 2024

Is your feature request related to an issue?

No

Describe the requested feature

We should make the memory requirement more clever. Given we already know that the memory consumption is ~7 of the max decompressed raw_records chunk: https://xe1t-wiki.lngs.infn.it/doku.php?id=xenon:xenonnt:analysis:analysis_tools_team:sr2_processing:memory_plan#sr0_and_sr1_below_peaks_peaklets_processing. This will not be a difficult implementation.

Describe your (preliminary) solution if there is one

Get the max chunk size information from DB.
Assign memory and disk usage accordingly.

dachengx moved this to Todo in Upgrade for SR2 reprocessing

dachengx added this to Upgrade for SR2 reprocessing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment