Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate run fcst #270

Draft
wants to merge 21 commits into
base: uwtools_integration
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
2d77662
Initial edits to coldstart and creation of run_fcst script
NaureenBharwaniNOAA Oct 11, 2024
4b03af5
Merge branch 'uwtools_integration' of https://github.com/NOAA-GSL/ufs…
NaureenBharwaniNOAA Oct 11, 2024
1c7faec
Updates to run_fcst script
NaureenBharwaniNOAA Oct 11, 2024
12f938c
Update command, fail jsonschema check
NaureenBharwaniNOAA Oct 17, 2024
4249ce2
Updates to config defaults
NaureenBharwaniNOAA Oct 18, 2024
c596c95
Update diag_table and file_copy config keys
NaureenBharwaniNOAA Oct 22, 2024
03e01d1
Config updates
NaureenBharwaniNOAA Oct 22, 2024
16e2ac0
Update config
NaureenBharwaniNOAA Oct 22, 2024
9947701
Update config
NaureenBharwaniNOAA Oct 23, 2024
3e7584e
WIP
christinaholtNOAA Oct 25, 2024
89e9fd1
Set the fix files directly in the fv3 config.
christinaholtNOAA Oct 30, 2024
caec469
Adding a quilting YAML.
christinaholtNOAA Oct 30, 2024
2e4eec1
Light testing fixes. Fixing stochastic namelist settings.
christinaholtNOAA Oct 30, 2024
aca7d70
Cleanup and applying black.
christinaholtNOAA Oct 30, 2024
0b92eb1
Merge pull request #1 from christinaholtNOAA/model_configure_to_yaml
NaureenBharwaniNOAA Oct 31, 2024
18ff149
Updates to config defaults and run script
NaureenBharwaniNOAA Oct 31, 2024
52f3c0f
Merge branch 'integrate-run-fcst' of https://github.com/NaureenBharwa…
NaureenBharwaniNOAA Oct 31, 2024
2c08014
Debugging
NaureenBharwaniNOAA Oct 31, 2024
5cf2b78
Debugging setup.py
NaureenBharwaniNOAA Oct 31, 2024
d22af95
Add fv3nml sfc back
NaureenBharwaniNOAA Oct 31, 2024
5ecc61f
Updates to make_grid
NaureenBharwaniNOAA Nov 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
546 changes: 0 additions & 546 deletions parm/FV3.input.yml

This file was deleted.

4 changes: 2 additions & 2 deletions parm/diag_table.FV3_RRFS_v1beta
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{{ starttime.strftime("%Y%m%d.%H") }}Z.{{ cres }}.32bit.non-hydro.regional
{{ starttime.strftime("%Y %m %d %H %M %S") }}
{{ cycle.strftime("%Y%m%d.%H") }}Z.{{ cres }}.32bit.non-hydro.regional
{{ cycle.strftime("%Y %m %d %H %M %S") }}

"grid_spec", -1, "months", 1, "days", "time"
"atmos_static", -1, "hours", 1, "hours", "time"
Expand Down
212 changes: 51 additions & 161 deletions parm/fixed_files_mapping.yaml
Original file line number Diff line number Diff line change
@@ -1,31 +1,4 @@
fixed_files:
#
#-----------------------------------------------------------------------
#
# FV3_NML_VARNAME_TO_SFC_CLIMO_FIELD_MAPPING:
# This array is used to set some of the namelist variables in the forecast
# model's namelist file that represent the relative or absolute paths of
# various fixed files (the first column of the array, where columns are
# delineated by the pipe symbol "|") to the full paths to surface climatology
# files (on the native FV3-LAM grid) in the FIXlam directory derived from
# the corresponding surface climatology fields (the second column of the
# array).
#
#-----------------------------------------------------------------------
#
FV3_NML_VARNAME_TO_SFC_CLIMO_FIELD_MAPPING: [
"FNALBC | snowfree_albedo",
"FNALBC2 | facsf",
"FNTG3C | substrate_temperature",
"FNVEGC | vegetation_greenness",
"FNVETC | vegetation_type",
"FNSOTC | soil_type",
"FNVMNC | vegetation_greenness",
"FNVMXC | vegetation_greenness",
"FNSLPC | slope_type",
"FNABSC | maximum_snow_albedo"
]

#
#-----------------------------------------------------------------------
#
Expand All @@ -34,150 +7,67 @@ fixed_files:
#
#-----------------------------------------------------------------------
#
SFC_CLIMO_FIELDS: [
"facsf",
"maximum_snow_albedo",
"slope_type",
"snowfree_albedo",
"soil_type",
"substrate_temperature",
"vegetation_greenness",
"vegetation_type",
]
SFC_CLIMO_FIELDS:
- facsf
- maximum_snow_albedo
- slope_type
- snowfree_albedo
- soil_type
- substrate_temperature
- vegetation_greenness
- vegetation_type

#
#-----------------------------------------------------------------------
#
# FNGLAC, ..., FNMSKH:
# Names of (some of the) global data files that are assumed to exist in
# a system directory specified (this directory is machine-dependent;
# the experiment generation scripts will set it and store it in the
# variable FIXgsm). These file names also appear directly in the forecast
# model's input namelist file.
#
#-----------------------------------------------------------------------
#
FNGLAC: &FNGLAC "global_glacier.2x2.grb"
FNMXIC: &FNMXIC "global_maxice.2x2.grb"
FNTSFC: &FNTSFC "RTGSST.1982.2012.monthly.clim.grb"
FNSNOC: &FNSNOC "global_snoclim.1.875.grb"
FNZORC: &FNZORC "igbp"
FNAISC: &FNAISC "CFSR.SEAICE.1982.2012.monthly.clim.grb"
FNSMCC: &FNSMCC "global_soilmgldas.t126.384.190.grb"
FNMSKH: &FNMSKH "seaice_newland.grb"
#
#-----------------------------------------------------------------------
#
# FIXgsm_FILES_TO_COPY_TO_FIXam:
# If not running in NCO mode, this array contains the names of the files
# to copy from the FIXgsm system directory to the FIXam directory under
# the experiment directory. Note that the last element has a dummy value.
# This last element will get reset by the workflow generation scripts to
# the name of the ozone production/loss file to copy from FIXgsm. The
# name of this file depends on the ozone parameterization being used,
# and that in turn depends on the CCPP physics suite specified for the
# experiment. Thus, the CCPP physics suite XML must first be read in to
# determine the ozone parameterizaton and then the name of the ozone
# production/loss file. These steps are carried out elsewhere (in one
# of the workflow generation scripts/functions).
# the experiment directory.
# The workflow generation step may add the name of the ozone
# production/loss file to copy from FIXgsm. The name of this file
# depends on the ozone parameterization being used, and that in turn
# depends on the CCPP physics suite specified for the experiment. Thus,
# the CCPP physics suite XML must first be read in to determine the
# ozone parameterizaton and then the name of the ozone production/loss
# file. These steps are carried out elsewhere (in one of the workflow
# generation scripts/functions).
#
#-----------------------------------------------------------------------
#
FIXgsm_FILES_TO_COPY_TO_FIXam: [
*FNGLAC,
*FNMXIC,
*FNTSFC,
*FNSNOC,
*FNAISC,
*FNSMCC,
*FNMSKH,
"global_climaeropac_global.txt",
"fix_co2_proj/global_co2historicaldata_2010.txt",
"fix_co2_proj/global_co2historicaldata_2011.txt",
"fix_co2_proj/global_co2historicaldata_2012.txt",
"fix_co2_proj/global_co2historicaldata_2013.txt",
"fix_co2_proj/global_co2historicaldata_2014.txt",
"fix_co2_proj/global_co2historicaldata_2015.txt",
"fix_co2_proj/global_co2historicaldata_2016.txt",
"fix_co2_proj/global_co2historicaldata_2017.txt",
"fix_co2_proj/global_co2historicaldata_2018.txt",
"fix_co2_proj/global_co2historicaldata_2019.txt",
"fix_co2_proj/global_co2historicaldata_2020.txt",
"fix_co2_proj/global_co2historicaldata_2021.txt",
"global_co2historicaldata_glob.txt",
"co2monthlycyc.txt",
"global_h2o_pltc.f77",
"global_hyblev.l65.txt",
"global_zorclim.1x1.grb",
"global_sfc_emissivity_idx.txt",
"global_tg3clim.2.6x1.5.grb",
"global_solarconstant_noaa_an.txt",
"global_albedo4.1x1.grb",
"geo_em.d01.lat-lon.2.5m.HGT_M.nc",
"HGT.Beljaars_filtered.lat-lon.30s_res.nc",
"replace_with_FIXgsm_ozone_prodloss_filename"
]
#
#-----------------------------------------------------------------------
#
# FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING:
# This array is used to set some of the namelist variables in the forecast
# model's namelist file that represent the relative or absolute paths of
# various fixed files (the first column of the array, where columns are
# delineated by the pipe symbol "|") to the full paths to these files in
# the FIXam directory derived from the corresponding workflow variables
# containing file names (the second column of the array).
#
#-----------------------------------------------------------------------
#
FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING: [
!join_str ["FNGLAC | ",*FNGLAC],
!join_str ["FNMXIC | ",*FNMXIC],
!join_str ["FNTSFC | ",*FNTSFC],
!join_str ["FNSNOC | ",*FNSNOC],
!join_str ["FNAISC | ",*FNAISC],
!join_str ["FNSMCC | ",*FNSMCC],
!join_str ["FNMSKH | ",*FNMSKH]
]

#
#-----------------------------------------------------------------------
#
# CYCLEDIR_LINKS_TO_FIXam_FILES_MAPPING:
# This array specifies the mapping to use between the symlinks that need
# to be created in each cycle directory (these are the "files" that FV3
# looks for) and their targets in the FIXam directory. The first column
# of the array specifies the symlink to be created, and the second column
# specifies its target file in FIXam (where columns are delineated by the
# pipe symbol "|").
#
#-----------------------------------------------------------------------
#
CYCLEDIR_LINKS_TO_FIXam_FILES_MAPPING: [
"aerosol.dat | global_climaeropac_global.txt",
"co2historicaldata_2010.txt | fix_co2_proj/global_co2historicaldata_2010.txt",
"co2historicaldata_2011.txt | fix_co2_proj/global_co2historicaldata_2011.txt",
"co2historicaldata_2012.txt | fix_co2_proj/global_co2historicaldata_2012.txt",
"co2historicaldata_2013.txt | fix_co2_proj/global_co2historicaldata_2013.txt",
"co2historicaldata_2014.txt | fix_co2_proj/global_co2historicaldata_2014.txt",
"co2historicaldata_2015.txt | fix_co2_proj/global_co2historicaldata_2015.txt",
"co2historicaldata_2016.txt | fix_co2_proj/global_co2historicaldata_2016.txt",
"co2historicaldata_2017.txt | fix_co2_proj/global_co2historicaldata_2017.txt",
"co2historicaldata_2018.txt | fix_co2_proj/global_co2historicaldata_2018.txt",
"co2historicaldata_2019.txt | fix_co2_proj/global_co2historicaldata_2019.txt",
"co2historicaldata_2020.txt | fix_co2_proj/global_co2historicaldata_2020.txt",
"co2historicaldata_2021.txt | fix_co2_proj/global_co2historicaldata_2021.txt",
"co2historicaldata_glob.txt | global_co2historicaldata_glob.txt",
"co2monthlycyc.txt | co2monthlycyc.txt",
"global_h2oprdlos.f77 | global_h2o_pltc.f77",
"global_albedo4.1x1.grb | global_albedo4.1x1.grb",
"global_zorclim.1x1.grb | global_zorclim.1x1.grb",
"global_tg3clim.2.6x1.5.grb | global_tg3clim.2.6x1.5.grb",
"sfc_emissivity_idx.txt | global_sfc_emissivity_idx.txt",
"solarconstant_noaa_an.txt | global_solarconstant_noaa_an.txt",
"global_o3prdlos.f77 | ozprdlos_2015_new_sbuvO3_tclm15_nuchem.f77"
]

FIXgsm_FILES_TO_COPY_TO_FIXam:
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNGLAC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNMXIC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNTSFC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNSNOC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNZORC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNAISC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNSMCC }}'
- '{{ fixed_files.FV3_NML_VARNAME_TO_FIXam_FILES_MAPPING.FNMSKH }}'
- global_climaeropac_global.txt
- fix_co2_proj/global_co2historicaldata_2010.txt
- fix_co2_proj/global_co2historicaldata_2011.txt
- fix_co2_proj/global_co2historicaldata_2012.txt
- fix_co2_proj/global_co2historicaldata_2013.txt
- fix_co2_proj/global_co2historicaldata_2014.txt
- fix_co2_proj/global_co2historicaldata_2015.txt
- fix_co2_proj/global_co2historicaldata_2016.txt
- fix_co2_proj/global_co2historicaldata_2017.txt
- fix_co2_proj/global_co2historicaldata_2018.txt
- fix_co2_proj/global_co2historicaldata_2019.txt
- fix_co2_proj/global_co2historicaldata_2020.txt
- fix_co2_proj/global_co2historicaldata_2021.txt
- global_co2historicaldata_glob.txt
- co2monthlycyc.txt
- global_h2o_pltc.f77
- global_hyblev.l65.txt
- global_zorclim.1x1.grb
- global_sfc_emissivity_idx.txt
- global_tg3clim.2.6x1.5.grb
- global_solarconstant_noaa_an.txt
- global_albedo4.1x1.grb
- geo_em.d01.lat-lon.2.5m.HGT_M.nc
- HGT.Beljaars_filtered.lat-lon.30s_res.nc
#
#-----------------------------------------------------------------------
#
Expand Down
120 changes: 0 additions & 120 deletions parm/model_configure

This file was deleted.

15 changes: 7 additions & 8 deletions parm/wflow/coldstart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -142,17 +142,16 @@ metatask_run_ensemble:

task_run_fcst_mem#mem#:
<<: *default_task
command: '&LOAD_MODULES_RUN_TASK; "run_fcst" "&JOBSdir;/JREGIONAL_RUN_FCST"'
envars:
<<: *default_vars
SLASH_ENSMEM_SUBDIR: '&SLASH_ENSMEM_SUBDIR;'
nprocs:
command: !cycstr 'source &USHdir;/load_modules_wflow.sh {{ user.MACHINE }} ; &SCRIPTSdir;/run_fcst.py
-c &GLOBAL_VAR_DEFNS_FP;
--cycle @Y-@m-@dT@H:@M:@S
--key-path task_run_fcst
--mem #mem#'
join: !cycstr '&LOGDIR;/{{ jobname }}_@Y@m@d@H&LOGEXT;'
nnodes: '{{ task_run_fcst.NNODES_RUN_FCST // 1 }}'
nodes: '{{ task_run_fcst.run_fcst.execution.batchargs.nodes }}:ppn={{ task_run_fcst.run_fcst.execution.batchargs.tasks_per_node }}'
partition: '{% if platform.get("PARTITION_FCST") %}&PARTITION_FCST;{% else %}None{% endif %}'
ppn: '{{ task_run_fcst.PPN_RUN_FCST // 1 }}'
queue: '&QUEUE_FCST;'
walltime: 04:30:00
walltime: 04:30:00
dependency:
and:
taskdep_make_ics:
Expand Down
5 changes: 0 additions & 5 deletions scripts/exregional_make_grid.sh
Original file line number Diff line number Diff line change
Expand Up @@ -736,11 +736,6 @@ failed."
#
#-----------------------------------------------------------------------
#
python3 $USHdir/set_fv3nml_sfc_climo_filenames.py \
--path-to-defns ${GLOBAL_VAR_DEFNS_FP} \
|| print_err_msg_exit "\
Call to function to set surface climatology file names in the FV3 namelist
file failed."
#
#-----------------------------------------------------------------------
#
Expand Down
Loading