clim_recal.config.ClimRecalConfig(self, command_dir=COMMAND_DIR_DEFAULT, run_prefix=RUN_PREFIX_DEFAULT, preprocess_data_file=PREPROCESS_FILE_NAME, run_cmethods_file=CMETHODS_FILE_NAME, data_path=DATA_PATH_DEFAULT, mod_folder=MOD_FOLDER_DEFAULT, obs_folder=OBS_FOLDER_DEFAULT, preprocess_out_folder=PREPROCESS_OUT_FOLDER_DEFAULT, cmethods_out_folder=CMETHODS_OUT_FOLDER_DEFAULT, calib_date_start=CALIB_DATE_START_DEFAULT, calib_date_end=CALIB_DATE_END_DEFAULT, valid_date_start=VALID_DATE_START_DEFAULT, valid_date_end=VALID_DATE_END_DEFAULT, processors=PROCESSORS_DEFAULT, date_format_str=CLI_DATE_FORMAT_STR, date_split_str=DATE_FORMAT_SPLIT_STR, variables=(VariableOptions.default()), runs=(RunOptions.default()), regions=(RegionOptions.default()), methods=(MethodOptions.default()), multiprocess=False, cpus=DEFAULT_CPUS, hads_input_path=RAW_HADS_PATH, cpm_input_path=RAW_CPM_PATH, output_path=DEFAULT_OUTPUT_PATH, convert_folder=DEFAULT_CONVERT_FOLDER, crops_folder=DEFAULT_CROPS_FOLDER, hads_output_folder=HADS_OUTPUT_PATH, cpm_output_folder=CPM_OUTPUT_PATH, cpm_kwargs=dict(), hads_kwargs=dict(), cpm_crop_kwargs=dict(), hads_crop_kwargs=dict(), convert_start_index=0, convert_stop_index=None, crop_start_index=0, crop_stop_index=None, add_local_dated_results_path=True, add_local_dated_crops_path=True, local_dated_results_path_prefix='run', local_dated_crops_path_prefix='crop', cpm_for_coord_alignment=None, process_cmp_for_coord_alignment=False, cpm_for_coord_alignment_path_converted=False, debug_mode=False)
clim_recal.config.ClimRecalConfig(self, command_dir=COMMAND_DIR_DEFAULT, run_prefix=RUN_PREFIX_DEFAULT, preprocess_data_file=PREPROCESS_FILE_NAME, run_cmethods_file=CMETHODS_FILE_NAME, data_path=DATA_PATH_DEFAULT, mod_folder=MOD_FOLDER_DEFAULT, obs_folder=OBS_FOLDER_DEFAULT, preprocess_out_folder=PREPROCESS_OUT_FOLDER_DEFAULT, cmethods_out_folder=CMETHODS_OUT_FOLDER_DEFAULT, calib_date_start=CALIB_DATE_START_DEFAULT, calib_date_end=CALIB_DATE_END_DEFAULT, valid_date_start=VALID_DATE_START_DEFAULT, valid_date_end=VALID_DATE_END_DEFAULT, processors=PROCESSORS_DEFAULT, date_format_str=CLI_DATE_FORMAT_STR, date_split_str=DATE_FORMAT_SPLIT_STR, variables=(VariableOptions.default()), runs=(RunOptions.default()), regions=(RegionOptions.default()), methods=(MethodOptions.default()), multiprocess=False, cpus=DEFAULT_CPUS, hads_input_path=RAW_HADS_PATH, cpm_input_path=RAW_CPM_PATH, output_path=DEFAULT_OUTPUT_PATH, resample_folder=DEFAULT_RESAMPLE_FOLDER, crops_folder=DEFAULT_CROPS_FOLDER, hads_output_folder=HADS_OUTPUT_LOCAL_PATH, cpm_output_folder=CPM_OUTPUT_LOCAL_PATH, cpm_kwargs=dict(), hads_kwargs=dict(), start_index=0, stop_index=None, add_local_dated_results_path=True, add_local_dated_crops_path=True, local_dated_results_path_prefix='run', local_dated_crops_path_prefix='crop', cpm_for_coord_alignment=None, process_cmp_for_coord_alignment=False, cpm_for_coord_alignment_path_converted=False, debug_mode=False)
Manage creating command line scripts to run debiasing cli.
Path to save all intermediate and final results to.
Path to append to output_path for resampling result files.Path to append to output_path for cropped convert files.Path to append to output_path for cropped resample files.Path to append to output_path / convert_folder for resampling HADs files and to output_path / crop_folder for crops.Path to append to output_path / resample_folder for resampling HADs files and to output_path / crop_folder for crops.Path to append to output_path / convert_folder for resampling CPM files and to output_path / crop_folder for crops.Path to append to output_path / resample_folder for resampling CPM files and to output_path / crop_folder for crops.dict of parameters to pass to a CPMConvertManager.dict of parameters to pass to a CPMResamplerManager.dict of parameters to pass to HADsConvertManager.dict of parameters to pass to HADsResamplerManager.>>> clim_runner: ClimRecalConfig = getfixture('clim_runner')
-'set_cpm_for_coord_alignment' for 'HADs' not speficied.
-Defaulting to 'self.cpm_input_path': '...'
->>> runs: dict[tuple, dict] = clim_runner.run_models()
->>> pprint(tuple(runs.keys()))
-(('Glasgow', 'tasmax', '05', 'quantile_delta_mapping'),
- ('Manchester', 'tasmax', '05', 'quantile_delta_mapping'))clim_recal.config.ClimRecalConfig.set_cpm_for_coord_alignment()
If cpm_for_coord_alignment is None use self.cpm_input_path.
It would be more efficient to use self.convert_cpm_path as long as that option is used, but support cases of only
It would be more efficient to use self.resample_cpm_path as long as that option is used, but support cases of only
New approach:
convert.pyresampling.pyx_grid and y_grid interpolation$ clim-recal --all-variables --default-runs --output-path /where/results/should/be/written
clim-recal pipeline configurations:
<ClimRecalConfig(variables_count=3, runs_count=4, regions_count=1, methods_count=1,
- cpm_folders_count=12, hads_folders_count=3, convert_start_index=0,
- convert_stop_index=None, cpus=2)>
-<CPMConvertManager(variables_count=3, runs_count=4, input_paths_count=12)>
-<HADsConvertManager(variables_count=3, input_paths_count=3)>
+ cpm_folders_count=12, hads_folders_count=3, start_index=0,
+ stop_index=None, cpus=2)>
+<CPMResamplerManager(variables_count=3, runs_count=4, input_paths_count=12)>
+<HADsResamplerManager(variables_count=3, input_paths_count=3)>
Otherwise, you can install locally and either run via pdm from the python folder
$ cd clim-recal/python
$ pdm run clim-recal --all-variables --default-runs --output-path /where/results/should/be/written
@@ -424,14 +424,14 @@ $ clim-recal --all-variables --default-runs --output-path /where/results/should/be/written --execute
clim-recal pipeline configurations:
<ClimRecalConfig(variables_count=3, runs_count=4, regions_count=1, methods_count=1,
- cpm_folders_count=12, hads_folders_count=3, convert_start_index=0,
- convert_stop_index=None, cpus=2)>
-<CPMConvertManager(variables_count=3, runs_count=4, input_paths_count=12)>
-<HADsConvertManager(variables_count=3, input_paths_count=3)>
+ cpm_folders_count=12, hads_folders_count=3, start_index=0,
+ stop_index=None, cpus=2)>
+<CPMResamplerManager(variables_count=3, runs_count=4, input_paths_count=12)>
+<HADsResamplerManager(variables_count=3, input_paths_count=3)>
Running CPM Standard Calendar projection...
-<CPMConvert(count=100, max_count=100,
+<CPMResampler(count=100, max_count=100,
input_path='/mnt/vmfileshare/ClimateData/Raw/UKCP2.2/tasmax/05/latest',
- output_path='/mnt/vmfileshare/ClimateData/CPM-365/test-run-3-may/convert/
+ output_path='/mnt/vmfileshare/ClimateData/CPM-365/test-run-3-may/resample/
cpm/tasmax/05/latest')>
100% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100/100 [ 0:38:27 < 0:00:00 , 0 it/s ]
87% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87/100 [ 0:17:42 < 0:03:07 , 0 it/s ]
clim_recal.pipeline.main(execute=False, hads_input_path=RAW_HADS_PATH, cpm_input_path=RAW_CPM_PATH, output_path=DEFAULT_OUTPUT_PATH, variables=(VariableOptions.default()), regions=(RegionOptions.default()), runs=(RunOptions.default()), methods=(MethodOptions.default()), all_variables=False, all_regions=False, default_runs=False, all_runs=False, all_methods=False, convert_hads=False, convert_cpm=False, crop_hads=True, crop_cpm=True, cpus=None, multiprocess=False, convert_start_index=0, convert_stop_index=None, crop_start_index=0, crop_stop_index=None, total=None, print_range_length=5, **kwargs)
clim_recal.pipeline.main(execute=False, hads_input_path=RAW_HADS_PATH, cpm_input_path=RAW_CPM_PATH, output_path=DEFAULT_OUTPUT_PATH, variables=(VariableOptions.default()), regions=(RegionOptions.default()), runs=(RunOptions.default()), methods=(MethodOptions.default()), all_variables=False, all_regions=False, default_runs=False, all_runs=False, all_methods=False, hads_projection=False, cpm_projection=False, crop_hads=True, crop_cpm=True, cpus=None, multiprocess=False, start_index=0, stop_index=None, total=None, print_range_length=5, **kwargs)
Run all elements of the pipeline.
convert_start_index |
+start_index |
int | Index to start all iterations from. | 0 |
convert_stop_index |
-int | None | -Number of files from convert_start_index to convert. |
-None |
-|
crop_start_index |
-int | -Index to start all crop iterations from. | -0 |
-|
crop_stop_index |
-int | None | -Number of files iterating from crop_start_index to crop. |
-None |
-|
total |
int | None | -Total number of records to iterate over. 0 and None indicate all values from convert_start_index. |
+Total number of records to iterate over. 0 and None indicate all values from start_index. |
None |
**kwargs |
Additional parameters to pass to a ClimRecalConfig. |
@@ -593,10 +575,10 @@