forked from NOAA-EMC/global-workflow
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge remote-tracking branch 'origin/develop' into feature/ss_180
* origin/develop: Create JEDI class (NOAA-EMC#2805) Restructure the bufr sounding job (NOAA-EMC#2853) Add an archive task to GEFS system to archive files locally (NOAA-EMC#2816) Reenable Orion Cycling Support (NOAA-EMC#2877) Eliminate race conditions and remove DATAROOT last in cleanup (NOAA-EMC#2893) Update aerosol climatology to 2013-2024 mean (NOAA-EMC#2888) Add ability to run CI test C96_atm3DVar.yaml to Gaea-C5 (NOAA-EMC#2885) Support global-workflow GEFS C48 on Google Cloud (NOAA-EMC#2861) Add 3 and 9 hr increment files to IC staging (NOAA-EMC#2876) Add diffusion/diag B for aerosol DA and some other needed changes (NOAA-EMC#2738) Correct ocean `MOM.res_#` stage copy (NOAA-EMC#2868) Support coupling on AWS (NOAA-EMC#2859) Add JEDI ATM lgetkf observer and solver jobs (NOAA-EMC#2833) Fix gdas build on Gaea and add Gaea to available CI list (NOAA-EMC#2857) Support ATM forecast only on Google (NOAA-EMC#2832) Add GEFS C48 support on AWS (NOAA-EMC#2818) Update omega calculation (NOAA-EMC#2751) Add snow DA update and recentering for the EnKF forecasts (NOAA-EMC#2690) support ATM forecast only on Azure (NOAA-EMC#2827) Convert staging job to python and yaml (NOAA-EMC#2651) Fixed test on UNAVAILBLE in python Rocoto check (NOAA-EMC#2842)
- Loading branch information
Showing
164 changed files
with
6,331 additions
and
1,313 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,55 @@ | ||
| #! /usr/bin/env bash | ||
|
|
||
| if [[ $# -ne 1 ]]; then | ||
|
|
||
| echo "Must specify an input argument to set runtime environment variables!" | ||
| exit 1 | ||
|
|
||
| fi | ||
|
|
||
| step=$1 | ||
|
|
||
| export launcher="srun -l --export=ALL" | ||
| export mpmd_opt="--multi-prog --output=mpmd.%j.%t.out" | ||
|
|
||
| # Configure MPI environment | ||
| export OMP_STACKSIZE=2048000 | ||
| export NTHSTACK=1024000000 | ||
|
|
||
| ulimit -s unlimited | ||
| ulimit -a | ||
|
|
||
| # Calculate common variables | ||
| # Check first if the dependent variables are set | ||
| if [[ -n "${ntasks:-}" && -n "${max_tasks_per_node:-}" && -n "${tasks_per_node:-}" ]]; then | ||
| max_threads_per_task=$((max_tasks_per_node / tasks_per_node)) | ||
| NTHREADSmax=${threads_per_task:-${max_threads_per_task}} | ||
| NTHREADS1=${threads_per_task:-1} | ||
| [[ ${NTHREADSmax} -gt ${max_threads_per_task} ]] && NTHREADSmax=${max_threads_per_task} | ||
| [[ ${NTHREADS1} -gt ${max_threads_per_task} ]] && NTHREADS1=${max_threads_per_task} | ||
| APRUN="${launcher} -n ${ntasks}" | ||
| else | ||
| echo "ERROR config.resources must be sourced before sourcing AZUREPW.env" | ||
| exit 2 | ||
| fi | ||
|
|
||
| if [[ "${step}" = "fcst" ]] || [[ "${step}" = "efcs" ]]; then | ||
|
|
||
| export launcher="srun --mpi=pmi2 -l" | ||
|
|
||
| (( nnodes = (ntasks+tasks_per_node-1)/tasks_per_node )) | ||
| (( ufs_ntasks = nnodes*tasks_per_node )) | ||
| # With ESMF threading, the model wants to use the full node | ||
| export APRUN_UFS="${launcher} -n ${ufs_ntasks}" | ||
| unset nnodes ufs_ntasks | ||
|
|
||
| elif [[ "${step}" = "post" ]]; then | ||
|
|
||
| export NTHREADS_NP=${NTHREADS1} | ||
| export APRUN_NP="${APRUN}" | ||
|
|
||
| export NTHREADS_DWN=${threads_per_task_dwn:-1} | ||
| [[ ${NTHREADS_DWN} -gt ${max_threads_per_task} ]] && export NTHREADS_DWN=${max_threads_per_task} | ||
| export APRUN_DWN="${launcher} -n ${ntasks_dwn}" | ||
|
|
||
| fi |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.