Skip to content

Commit

Permalink
Update src/hipscat_import/pipeline_resume_plan.py
Browse files Browse the repository at this point in the history
Co-authored-by: Melissa DeLucchi <[email protected]>
  • Loading branch information
camposandro and delucchi-cmu authored Aug 26, 2024
1 parent bc64f9b commit 42a9877
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/hipscat_import/pipeline_resume_plan.py
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,8 @@ class PipelineResumePlan:
if False, we will keep all sub-histograms from the mapping stage, and all
done marker files at the end of the pipeline."""
delete_intermediate_parquet_files: bool = True
"""should we delete the smaller intermediate parquet files generated in the
mapping stage, once the relevant reducing stage is complete?"""
"""should we delete any smaller intermediate parquet files that may be
generated by the pipeline?"""

ORIGINAL_INPUT_PATHS = "input_paths.txt"

Expand Down

0 comments on commit 42a9877

Please sign in to comment.