diff --git a/docs/assets/model_evaluation/Gadi-19-2.jpg b/docs/assets/model_evaluation/Gadi-19-2.jpg new file mode 100644 index 000000000..c587a00ca Binary files /dev/null and b/docs/assets/model_evaluation/Gadi-19-2.jpg differ diff --git a/docs/assets/model_evaluation/condaenv_list.png b/docs/assets/model_evaluation/condaenv_list.png new file mode 100644 index 000000000..8af8da411 Binary files /dev/null and b/docs/assets/model_evaluation/condaenv_list.png differ diff --git a/docs/assets/model_evaluation/condaenv_raise_issue.png b/docs/assets/model_evaluation/condaenv_raise_issue.png new file mode 100644 index 000000000..f4e4b0af2 Binary files /dev/null and b/docs/assets/model_evaluation/condaenv_raise_issue.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png b/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png new file mode 100644 index 000000000..3d4fbe180 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-3.png b/docs/assets/model_evaluation/esmvaltool/fig-9-3.png new file mode 100644 index 000000000..314d6ed58 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-3.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-4.png b/docs/assets/model_evaluation/esmvaltool/fig-9-4.png new file mode 100644 index 000000000..e8bc5a87a Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-4.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-8.png b/docs/assets/model_evaluation/esmvaltool/fig-9-8.png new file mode 100644 index 000000000..1f8af11d7 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-8.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png b/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png new file mode 100644 index 000000000..e05bfbbcd Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png b/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png new file mode 100644 index 000000000..8ae08da9f Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png differ diff --git a/docs/assets/model_evaluation/logo_cosima.png b/docs/assets/model_evaluation/logo_cosima.png new file mode 100644 index 000000000..9e762b386 Binary files /dev/null and b/docs/assets/model_evaluation/logo_cosima.png differ diff --git a/docs/assets/model_evaluation/logo_esmvaltool.png b/docs/assets/model_evaluation/logo_esmvaltool.png new file mode 100644 index 000000000..e87621903 Binary files /dev/null and b/docs/assets/model_evaluation/logo_esmvaltool.png differ diff --git a/docs/assets/model_evaluation/logo_ilamb.png b/docs/assets/model_evaluation/logo_ilamb.png new file mode 100644 index 000000000..cf3a77f9a Binary files /dev/null and b/docs/assets/model_evaluation/logo_ilamb.png differ diff --git a/docs/assets/model_evaluation/logo_pangeo.png b/docs/assets/model_evaluation/logo_pangeo.png new file mode 100644 index 000000000..0f1c636d3 Binary files /dev/null and b/docs/assets/model_evaluation/logo_pangeo.png differ diff --git a/docs/assets/model_evaluation/model_evaluation_conda.png b/docs/assets/model_evaluation/model_evaluation_conda.png new file mode 100644 index 000000000..b2fbb4f44 Binary files /dev/null and b/docs/assets/model_evaluation/model_evaluation_conda.png differ diff --git a/docs/assets/model_evaluation/model_evaluation_variables.png b/docs/assets/model_evaluation/model_evaluation_variables.png new file mode 100644 index 000000000..cbf411a49 Binary files /dev/null and b/docs/assets/model_evaluation/model_evaluation_variables.png differ diff --git a/docs/call_contribute.md b/docs/call_contribute.md index 9d1c06d23..d1eec4a20 100644 --- a/docs/call_contribute.md +++ b/docs/call_contribute.md @@ -1,2 +1,2 @@ ???+ warning "The documentation on Hive is work in progress!" - The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself. \ No newline at end of file + The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](/contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself. \ No newline at end of file diff --git a/docs/community_resources/community_med_recipes.md b/docs/community_resources/community_med_recipes.md index acbf87e48..a153d1d60 100644 --- a/docs/community_resources/community_med_recipes.md +++ b/docs/community_resources/community_med_recipes.md @@ -360,4 +360,23 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB + + + +
+ Pythia Cookbooks {{ community }} +
+ + + + +
+ Documentation | + Source + +
+ + + + \ No newline at end of file diff --git a/docs/community_resources/glossaries/glossary_access_nri.md b/docs/community_resources/glossaries/glossary_access_nri.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_access_nri.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/glossary_cmip.md b/docs/community_resources/glossaries/glossary_cmip.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_cmip.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/glossary_cssr.md b/docs/community_resources/glossaries/glossary_cssr.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_cssr.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/glossary_era.md b/docs/community_resources/glossaries/glossary_era.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_era.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/glossary_ipcc.md b/docs/community_resources/glossaries/glossary_ipcc.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_ipcc.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/glossary_um.md b/docs/community_resources/glossaries/glossary_um.md deleted file mode 100644 index 954512251..000000000 --- a/docs/community_resources/glossaries/glossary_um.md +++ /dev/null @@ -1,11 +0,0 @@ -#
Glossary and Useful Terms
- -Here you can find a compilation of common terms and acronyms used by the Australian Community Climate and Earth System Simulator (ACCESS) community: - - - [ACCESS-NRI Glossary](https://www.access-nri.org.au/community/access-glossary/): This includes common terms and acronyms used by the ACCESS community in research and modelling of past, present and future climate, weather and Earth-Systems. - - - [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. diff --git a/docs/community_resources/glossaries/index.md b/docs/community_resources/glossaries/index.md index 96b7a76ff..7c04828cc 100644 --- a/docs/community_resources/glossaries/index.md +++ b/docs/community_resources/glossaries/index.md @@ -7,10 +7,4 @@ Here you can find a compilation of common terms and acronyms used by the Austral [IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change. - [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. - - [CMIP(6)](#): - - [ERA(5)](#): - - [UM](#): + [CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States. \ No newline at end of file diff --git a/docs/community_resources/index.md b/docs/community_resources/index.md index 0bb253311..e433a5c36 100644 --- a/docs/community_resources/index.md +++ b/docs/community_resources/index.md @@ -7,7 +7,6 @@ In this area of the Hive, we collect content that is not currated by us, but may Currently, we provide pointers to the following categories: - [Working Groups](community_working_groups.md) - [Glossaries](./glossaries/index.md) -- [Variables](./glossaries/glossary_cmip.md) - [Model Evaluation Links](community_model_catalogs) - [Training](training/) - [Events](./events/index.md) diff --git a/docs/model_evaluation/index.md b/docs/model_evaluation/index.md index 0d7dac986..9897e74de 100644 --- a/docs/model_evaluation/index.md +++ b/docs/model_evaluation/index.md @@ -1,26 +1,122 @@ -# Model Evaluation and Diagnostics (MED) - -Model evaluation is about measuring how fit for purpose a particular model is. - -If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). - -Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We provide [tools to process such data](./model_evaluation_data_processing.md) into a comparable format and a [gallery of recipes to evaluate](https://medportal.herokuapp.com/models/published) the formatted data. - -
- - - - - - -
-
A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty ImagesObservational Data Catalog -
 -
Model Data Catalog -
 -
A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/Data Format Processing -
 -
A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipesEvaluation Recipe Gallery -
- -Our vision: PLACEHOLDER FOR OUTCOME OF STAFF RETREAT \ No newline at end of file +#
Model Evaluation and Diagnostics (MED)
+ + + +## What is MED about? + +ACCESS-NRI's "Model Evaluation and Diagnostics" work is a critical facet of climate modeling, encompassing various tasks designed to ensure the model's reliability and accuracy. + +**Evaluation** involves scrutinizing the model through Model/Observation confrontations, checking its performance against real-world observations. It also includes experiment comparisons, testing the model under different scenarios, and inter-model comparisons like the Coupled Model Intercomparison Project (CMIP), assessing how the ACCESS-NRI model fares when compared with other climate models. + +**Diagnostics** involves constant monitoring of model runs to detect any anomalies or inconsistencies and a thorough analysis of outputs to verify the model's accuracy over time. + +## ACCESS-MED data and tools hosted on Gadi + +If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We also provide a number of [frameworks for model evaluation](./model_evaluation_on_gadi/index.md). We are also working on implementing more frameworks and recipes as well as formatting tools for a better model evaluation and diagnostics. + +### Getting Started +
+ +
+ Computing Access +
+
Computing Access
+ + +
+ MED Conda Environment +
+
MED Conda Environment
+ + +
+ Model Variables +
+
Model Variables
+ +
+ +### Data Catalogs +
+ +
+ A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images +
+
Observational Data Catalog
+ + +
+ MED Conda Environment +
+
Model Data Catalog
+ +
+ +### Supported Community Frameworks on Gadi + +
+ +
+ ILAMB +
+
ILAMB
+ + +
+ ESMValTool +
+
ESMValTool
+ + +
+ Pangeo/COSIMA +
+
COSIMA cookbook
+ +
+ +### Tools in development + +We are currently setting up a range of tools that will help you to better evaluate and diagnose climate models: +* Model Diagnostics for on-the-fly analysis of your models at different snapshots +* Data format processing tools like APP4 +* An Evaluation Recipe Gallery with searching functionality + +While we are working on these, we have collected a number of links to existing tools in our [community tab](../community_resources/index.md) (note that we are not currating them). + +{% include "call_contribute.md" %} + + + + + \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_getting_started/index.md b/docs/model_evaluation/model_evaluation_getting_started/index.md index 0855f525b..5fd3c8792 100644 --- a/docs/model_evaluation/model_evaluation_getting_started/index.md +++ b/docs/model_evaluation/model_evaluation_getting_started/index.md @@ -4,5 +4,23 @@ Welcome to Model Evaluation and Diagnostics! Here, we provide you the important information to give you access to the large data that we curate at NCI's storage and show you how you can use it to figure out how fit for purpose specific models are, in particular when you compare them to osbervational data: -1) [Getting Access to NCI and relevant NCI projects](./access_to_gadi_at_nci.md) -2) [Setting up environments at gadi@NCI to load and evaluate observational and model data](./model_evaluation_getting_started.md) \ No newline at end of file +
+ +
+ Computing Access +
+
Computing Access
+ + +
+ MED Conda Environment +
+
MED Conda Environment
+ + +
+ Model Variables +
+
Model Variables
+ +
\ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md b/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md index e8776b523..ecd9d1a8d 100644 --- a/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md +++ b/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md @@ -1,41 +1,32 @@ -# Getting Started with Model Evaluation at Gadi@NCI +# Model Evaluation Environment at Gadi@NCI -At this stage of *Getting Started*, we assume that you already have access to Gadi@NCI. If this is not the case, please go to our instructions on how to get [access to Gadi@NCI](./access_to_gadi_at_nci.md) +At this stage of *Getting Started*, we assume that you already have access to Gadi@NCI. If this is not the case, please go to our instructions on how to get [access to Gadi@NCI](./access_to_gadi_at_nci.md). Here we describe where you can find, load, and evalulate observational and model data on Gadi. -Note: You do not automatically have access to all of Gadi's storage at `/g/data/`, but need to be part of a `$PROJECT` to see files at `/g/data/$PROJECT`. Furthermore, if you use Gadi's job submission system PBS (Portable Batch System), you need to add the relevant storage to the `#PBS -l storage=gdata/xp65+gdata/kj13` (if you want the job to have access to `xp65` and `kj13` in this example). +???+ warning "ACCESS-NRI provides code and data, but not computing resources" + You do not automatically have access to all of Gadi's storage at `/g/data/`, but need to be part of a `$PROJECT` to see files at `/g/data/$PROJECT`. Furthermore, if you use Gadi's job submission system PBS (Portable Batch System), you need to add the relevant storage to the `#PBS -l storage=gdata/xp65+gdata/kj13` (if you want the job to have access to `xp65` and `kj13` in this example). -### 2.1) `access-med`: Our currated `conda` environment for you on Gadi +## 1 `access-med`: Our currated `conda` environment on Gadi To avoid running multiple (different) versions of code on Gadi, we provide you with a `conda` environment called `access-med` that we actually curate for you (version 0.1 is from June 2023). In order to change to this environment, please execute the following commands after loggin onto Gadi (and as part of your PBS scripts): ``` $ module use /g/data/xp65/public/modules -$ module load conda/access-med-0.1 +$ module load conda/access-med ``` If you are planning to run your code through JupyterLab on [NCI's ARE](https://are.nci.org.au), you need to use `/g/data/xp65/public/modules` as **Module directories** and `conda/are` as **Modules** when launching a JupyterLab session. -You are now able to use the scripts of our currated environment, including `python3`, `intake`, `jupyter`, `esmvaltool`, or `ilamb`. The complete list of dependencies can be found in our dedicated [GitHub repository](https://github.com/ACCESS-NRI/MED-condaenv/blob/main/scripts/environment.yml). +## 2 What is part of the `access-med` enrivonment? -### 2.2) Observational Data +You are now able to use the scripts of our currated environment, including `python3`, `intake`, `jupyter`, `esmvaltool`, or `ilamb`. The complete list of dependencies can be found in the `environment.yml` file of our [GitHub repository](https://github.com/ACCESS-NRI/MED-condaenv/blob/main/scripts/environment.yml): -We provide an extensive collection of observational data on Gadi@NCI within the `/g/data/kj13/datasets` directory. +[![Raise Issue](../../assets/model_evaluation/condaenv_list.png)](https://github.com/ACCESS-NRI/MED-condaenv/issues) -Please take a look at our [Observational Data Catalog](../model_evaluation_observational_catalogs.md) for an overview. +## 3 If you need more packages -### 2.3) Model Data +Simply raise an issue to *add a package* in our [ACCESS-NRI/MED-condaenv GitHub repository](https://github.com/ACCESS-NRI/MED-condaenv/issues): -There are many models and data stored on Gadi, as you can imagine from the plethora of projects in [Section 1.2](#12-join-relevant-nci-projects). Downloading this data is hardly practical, so we suggest to work on Gadi instead. - -To avoid endless searches within Gadi's storage, we written a useful 'library' tool, called `access-nri-catalog`, that allows to search the Model Catalogs easily and is already loaded as part of our `access-med` `conda` environment. To find out how you can search for Model Data on Gadi, take a look at our [Model Catalog](../model_evaluation_model_catalogs/model_evaluation_search_models.md). - -### 2.5) Model Evaluation - -Now that you have both [Observational Data](#22-observational-data) and [Model Data](#23-model-data) at the palm of your hand on Gadi@NCI, there are many ways to evaluate this data. - -As part of our ACCESS-NRI `conda` environment, we provide several Model Evaluation Tools, like `ilamb` or `esmvaltool`. - -Check out [Model Evaluation at Gadi](../model_evaluation_on_gadi/index.md) to find out how you can use them on Gadi. \ No newline at end of file +[![Raise Issue](../../assets/model_evaluation/condaenv_raise_issue.png)](https://github.com/ACCESS-NRI/MED-condaenv/issues) \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md b/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md new file mode 100644 index 000000000..9a12dd61a --- /dev/null +++ b/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md @@ -0,0 +1,17 @@ +# Model Output and Variables + +Speaking a common language and using the same variables is key for a united climate modelling community. While we are trying to bring together modellers from different communities, we understand that the variables used for climate modelling may differ for historical reasons. Here, we are collating lists of different widely used variable formats. + + + + + +# Variables for CMIP version 6
(Coupled Model Intercomparison Project) + +You can search the extensive list of Coupled Model Intercomparison Project version 6 on [this website](Chttps://clipc-services.ceda.ac.uk/dreq/index/var.html). + +# Variables for ERA5 atmospheric reanalysis + +ERA5 is the fifth generation ECMWF atmospheric reanalysis of the global climate covering the period from January 1940 to present. ERA5 is produced by the Copernicus Climate Change Service (C3S) at ECMWF. ERA5 provides hourly estimates of a large number of atmospheric, land and oceanic climate variables. + +A full list of ERA5 parameters is available on the [ECMWF database](https://codes.ecmwf.int/grib/param-db/). It covers both the [ERA5 parameter listings](https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation#ERA5:datadocumentation-Parameterlistings) as well as the [ERA5-LAND parameter listings](https://confluence.ecmwf.int/display/CKB/ERA5-Land%3A+data+documentation#ERA5Land:datadocumentation-parameterlistingParameterlistings). \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_observational_catalogs.md b/docs/model_evaluation/model_evaluation_observational_catalogs.md index 2a5c93bc7..c7efd0b80 100644 --- a/docs/model_evaluation/model_evaluation_observational_catalogs.md +++ b/docs/model_evaluation/model_evaluation_observational_catalogs.md @@ -1,6 +1,6 @@ # Observational Data Catalog -As of June 2023, we provide the following observational data catalogs on Gadi@NCI through the project `kj13`: + \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_on_gadi/index.md b/docs/model_evaluation/model_evaluation_on_gadi/index.md index 0ef406878..d43d289de 100644 --- a/docs/model_evaluation/model_evaluation_on_gadi/index.md +++ b/docs/model_evaluation/model_evaluation_on_gadi/index.md @@ -1,5 +1,30 @@ -# Model Evaluation on Gadi +# Model Evaluation on Gadi/NCI -To kick-start your model evaluation efforts, we provide the following tools as part of our `access-med` `conda` environment (and tutorials for how to use them on Gadi@NCI): - - [ilamb](./model_evaluation_on_gadi_ilamb.md), a tool for [International Land (and Ocean) Model Benchmarking](https://www.ilamb.org). - - [esmvaltool](./model_evaluation_on_gadi_esmvaltool.md), an [Earth System Model Evaluation Tool](https://esmvaltool.org.) \ No newline at end of file +We are providing support for an increasing amount of frameworks and recipes on Gadi/NCI. + +At the moment, we are actively supporting: + +
+ +
+ ILAMB +
+
ILAMB
+ + +
+ ESMValTool +
+
ESMValTool
+ + +
+ Pangeo/COSIMA +
+
COSIMA cookbook
+ +
+ +The best way to get our help is by raising an issue on the [community forum](https://forum.access-hive.org.au/) with tags `help` and another tag for the specific framework. + +In the future, we are also aiming to support a broader range of frameworks and recipes. \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md index b37b88b32..fefa1c681 100644 --- a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md +++ b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md @@ -1,3 +1,157 @@ # Tutorial for using `esmvaltool` on Gadi@NCI - \ No newline at end of file +{% include "call_contribute.md" %} + +ACCESS-NRI is currating the latest version of [ESMValTool](). + +Below, we give a quick overview on how to run and configure `esmvaltool` on Gadi. + +## Running `esmvaltool` on Gadi + +#### What recipes are available? +``` + esmvaltool recipes list +``` + +#### Details of a recipe +``` +esmvaltool recipes show recipe_name.yml +``` + +#### Running an recipe yourself + +``` +esmvaltool run examples/recipe_python.yml --search_esgf=when_missing +``` + +## Working `esmvaltool` recipes on Gadi + + + +Below you can find the recipes from `esmvaltool` that we are providing to run on Gadi. The original recipes are + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ recipe_flato13ipcc.yml + recipe_perfmetrics_CMIP5.yml + recipe_ecs_scatter.yml
+ recipe_flato13ipcc.yml + recipe_flato13ipcc.yml + recipe_diurnal_index.yml
+ recipe_crem.yml + recipe_collins13ipcc.yml + recipe_autoassess_stratosphere.yml
+ recipe_lauer13jclim.yml + recipe_zmnam.yml + recipe_russell18jgr.yml
+ recipe_sea_surface_salinity.yml + recipe_schlund20esd.yml + recipe_runoff_et.yml
+ recipe_perfmetrics_CMIP5.yml + recipe_spei.yml + recipe_runoff_et.yml
+ recipe_hyint.yml + recipe_cox18_nature.yml + recipe_extreme_events.yml
+ recipe_smpi.yml + recipe_landcover.yml + recipe_miles_block.yml
+ recipe_esacci_oc.yml + recipe_ocean_ice_extent.yml + recipe_ocean_amoc.yml
diff --git a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md index d4f9cf31e..def0eb20c 100644 --- a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md +++ b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md @@ -1,5 +1,27 @@ -# Tutorial for using `pangeo` & COSIMA on Gadi@NCI +# COSIMA cookbooks on NCI's Gadi + - +COSIMA is the Consortium for Ocean-Sea Ice Modelling in Australia, which brings together Australian researchers involved in global ocean and sea ice modelling. The consortium provides a collection of `cosmia-recipes` for the evaluation of ocean-sea ice modelling that are currated for you on Gadi. -https://pangeo.io \ No newline at end of file + + +## Getting Started + +The easiest way to use the COSIMA Cookbook is through NCI's HPC systems. The cookbook is preinstalled both in the latest `access-med` (project `xp65`) and `conda/analysis3` (project hh5) environments. + +1. Clone the cosima-recipes repository to your local file space. +2. Start an [ARE JupyterLab session on NCI](https://are.nci.org.au) or a jupyter notebook on Gadi: + *If you are using ARE*: + **Storage**: gdata/xp65+gdata/ik11 + **Module directories**: /g/data/xp65/public/modules + **Modules**: conda/are +3. Navigate to one of the COSIMA recipes and run the analysis. + +## Using the Cookbook + +The COSIMA Cookbook is a framework for analysing output from ocean-sea ice models. The focus is on the ACCESS-OM2 suite of models being developed and run by members of [COSIMA: Consortium for Ocean-Sea Ice Modelling in Australia](http://cosima.org.au/). But this framework is suited to analysing any MOM5/MOM6 output, as well as output from other models. + +The cookbook is structured as follows: + * This repository includes boiler-plate code and scripts that underpin the cookbook. + * The [cosima-recipes](https://github.com/COSIMA/cosima-recipes) repository includes example notebooks on which you can base your analyses, including a [collection of useful examples](https://cosima-recipes.readthedocs.io/en/latest/documented_examples.html). + * The cosima-recipes [template](https://github.com/COSIMA/cosima-recipes/blob/master/Tutorials/Template_For_Notebooks.ipynb) provides you with a template if you want to contribute your own scripts to the analysis. \ No newline at end of file diff --git a/mkdocs.yml b/mkdocs.yml index 0c4440686..f120640e6 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -128,7 +128,7 @@ nav: # - Getting Started: # - models/running-a-model/getting_started/index.md # - Access to Gadi@NCI: models/running-a-model/getting_started/access_to_gadi_at_nci.md - - Computing Access (Gadi@NCI): models/run-a-model/getting_started/access_to_gadi_at_nci.md + - Gadi Computing Access at NCI: models/run-a-model/getting_started/access_to_gadi_at_nci.md - Run ACCESS-ESM: models/run-a-model/run-access-esm.md - Run ACCESS-CM: models/run-a-model/run-access-cm.md - Run ACCESS-AM: models/run-a-model/run-access-am.md @@ -138,8 +138,11 @@ nav: - model_evaluation/index.md - Getting Started: - model_evaluation/model_evaluation_getting_started/index.md - - Computing Access (Gadi@NCI): model_evaluation/model_evaluation_getting_started/access_to_gadi_at_nci.md + - Gadi Computing Access at NCI: model_evaluation/model_evaluation_getting_started/access_to_gadi_at_nci.md - Model Evaluation on Gadi: model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md + - Model Variables: model_evaluation/model_evaluation_getting_started/model_variables/index.md + # - CMIP6: model_evaluation/model_evaluation_getting_started/model_variables/variables_cmip6.md + # - ERA5: model_evaluation/model_evaluation_getting_started/model_variables/variables_era5.md - Data Catalogs: - Observational Data: model_evaluation/model_evaluation_observational_catalogs.md - Model Data: @@ -149,21 +152,17 @@ nav: - Model Format Processing: model_evaluation/model_evaluation_data_processing.md - Evaluation Tools: - model_evaluation/model_evaluation_on_gadi/index.md - - Frameworks on Gadi: - - ILAMB: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_ilamb.md - - ESMValTool: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md - - Pangeo & COSIMA: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md - - Live-Diagnostics on Gadi: model_evaluation/model_evaluation_live_diagnostics.md - - Evaluation Recipe Gallery: model_evaluation/model_evaluation_recipe_gallery.md + # - Frameworks on Gadi: + - ILAMB: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_ilamb.md + - ESMValTool: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md + - COSIMA cookbook: model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima.md + # - Live-Diagnostics on Gadi: model_evaluation/model_evaluation_live_diagnostics.md + # - Evaluation Recipe Gallery: model_evaluation/model_evaluation_recipe_gallery.md - Community Resources: - community_resources/index.md - Working Groups: community_resources/community_working_groups.md - Glossaries: community_resources/glossaries/index.md - - Variables: - - CMIP(6): community_resources/glossaries/glossary_cmip.md - - ERA(5): community_resources/glossaries/glossary_era.md - - UM: community_resources/glossaries/glossary_um.md - Model Evaluation Links: - Observational Catalogs: community_resources/community_observational_catalogs.md - Model Catalogs: community_resources/community_model_catalogs.md