Skip to content

Commit

Permalink
Merge pull request #428 from ACCESS-Hive/dev/sven/vars
Browse files Browse the repository at this point in the history
Dev/sven/vars
  • Loading branch information
svenbuder authored Jul 13, 2023
2 parents 0cb118c + 8a4aab5 commit 3d89d13
Show file tree
Hide file tree
Showing 34 changed files with 414 additions and 146 deletions.
Binary file added docs/assets/model_evaluation/Gadi-19-2.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/condaenv_list.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/logo_cosima.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/logo_esmvaltool.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/logo_ilamb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/logo_pangeo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion docs/call_contribute.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
???+ warning "The documentation on Hive is work in progress!"
The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself.
The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](/contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself.
19 changes: 19 additions & 0 deletions docs/community_resources/community_med_recipes.md
Original file line number Diff line number Diff line change
Expand Up @@ -360,4 +360,23 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
</tr>


<tr>
<td width="25%">
<div align='center' width="100%">
<a href="https://cookbooks.projectpythia.org">Pythia Cookbooks {{ community }}</a>
</div>
</td>
<td width="10%">
</td>
<td width="64%">
<div align='center' width="100%" >
<a href="https://cookbooks.projectpythia.org">Documentation</a> |
<a href="https://github.com/ProjectPythia">Source </a>
<!-- The Afterburner project is a multi-year initiative of the UK Met Office to develop a suite of robust, reusable scientific software tools and applications which can be integrated into climate model runs to deliver commonly needed in-line (as a model is running) and post-processing functionality. The project is funded by the UK government through a combination of direct grant and the ​[Newton Fund](http://www.newtonfund.ac.uk). -->
</div>
</td>
</tr>


<table/>
11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_access_nri.md

This file was deleted.

11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_cmip.md

This file was deleted.

11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_cssr.md

This file was deleted.

11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_era.md

This file was deleted.

11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_ipcc.md

This file was deleted.

11 changes: 0 additions & 11 deletions docs/community_resources/glossaries/glossary_um.md

This file was deleted.

8 changes: 1 addition & 7 deletions docs/community_resources/glossaries/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,10 +7,4 @@ Here you can find a compilation of common terms and acronyms used by the Austral

[IPCC Acronyms](https://www.ipcc.ch/site/assets/uploads/sites/2/2022/06/SR15_AnnexI.pdf): Contains a comprehensive list of acronyms published in the scientific report SR15 of the Intergovernmental Panel on Climate Change (IPCC). The IPCC is the United Nations body for assessing the science related to climate change.

[CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States.

[CMIP(6)](#):

[ERA(5)](#):

[UM](#):
[CSSR Acronyms and Units](https://science2017.globalchange.gov/chapter/appendix-d/): The Climate Science Special Report (CSSR) is an assessment of the science of climate change with particular focus on the United States.
1 change: 0 additions & 1 deletion docs/community_resources/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ In this area of the Hive, we collect content that is not currated by us, but may
Currently, we provide pointers to the following categories:
- [Working Groups](community_working_groups.md)
- [Glossaries](./glossaries/index.md)
- [Variables](./glossaries/glossary_cmip.md)
- [Model Evaluation Links](community_model_catalogs)
- [Training](training/)
- [Events](./events/index.md)
148 changes: 122 additions & 26 deletions docs/model_evaluation/index.md
Original file line number Diff line number Diff line change
@@ -1,26 +1,122 @@
# Model Evaluation and Diagnostics (MED)

Model evaluation is about measuring how fit for purpose a particular model is.

If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md).

Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We provide [tools to process such data](./model_evaluation_data_processing.md) into a comparable format and a [gallery of recipes to evaluate](https://medportal.herokuapp.com/models/published) the formatted data.

<table class="center">
<tr>
<td width="24%">
<div align='center' width="100%" ><a href="./model_evaluation_observational_catalogs.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_obs_catalog.jpg" alt="A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images" title="Image credit: Wf Sihardian—EyeEm/Getty Images">Observational Data Catalog</img></a>
</td>
<td width="24%">
<div align='center' width="100%" ><a href="./model_evaluation_model_catalogs/index.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_model_catalog.jpg" alt="" >Model Data Catalog</img></a>
</td>
<td width="24%">
<div align='center' width="100%" ><a href="./model_evaluation_data_processing.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_formatting.jpg" alt="A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/" title="Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/">Data Format Processing</img></a>
</td>
<td width="24%">
<div align='center' width="100%" ><a href="./model_evaluation_recipe_gallery.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_recipe.jpg" alt="A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipes" title="Image credit: https://github.com/COSIMA/cosima-recipes">Evaluation Recipe Gallery</img></a>
</td>
</tr>
</table>

Our vision: PLACEHOLDER FOR OUTCOME OF STAFF RETREAT
# <div class="highlight-bg"> Model Evaluation and Diagnostics (MED) </div>

<!-- Model evaluation is about measuring how fit for purpose a particular model is. -->

## What is MED about?

ACCESS-NRI's "Model Evaluation and Diagnostics" work is a critical facet of climate modeling, encompassing various tasks designed to ensure the model's reliability and accuracy.

**Evaluation** involves scrutinizing the model through Model/Observation confrontations, checking its performance against real-world observations. It also includes experiment comparisons, testing the model under different scenarios, and inter-model comparisons like the Coupled Model Intercomparison Project (CMIP), assessing how the ACCESS-NRI model fares when compared with other climate models.

**Diagnostics** involves constant monitoring of model runs to detect any anomalies or inconsistencies and a thorough analysis of outputs to verify the model's accuracy over time.

## ACCESS-MED data and tools hosted on Gadi

If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We also provide a number of [frameworks for model evaluation](./model_evaluation_on_gadi/index.md). We are also working on implementing more frameworks and recipes as well as formatting tools for a better model evaluation and diagnostics.

### Getting Started
<div class="card-container">
<a href="./model_evaluation_getting_started/access_to_gadi_at_nci" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="..//assets/model_evaluation/Gadi-19-2.jpg" alt="Computing Access"></img>
</div>
<div class="squared-card-text bold">Computing Access</div>
</a>
<a href="./model_evaluation_getting_started/model_evaluation_getting_started" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_conda.png" alt="MED Conda Environment"></img>
</div>
<div class="squared-card-text bold">MED Conda Environment</div>
</a>
<a href="./model_evaluation_getting_started/model_variables" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_variables.png" alt="Model Variables"></img>
</div>
<div class="squared-card-text bold">Model Variables</div>
</a>
</div>

### Data Catalogs
<div class="card-container">
<a href="./model_evaluation_observational_catalogs" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_obs_catalog.jpg" alt="A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images" title="Image credit: Wf Sihardian—EyeEm/Getty Images"></img>
</div>
<div class="squared-card-text bold">Observational Data Catalog</div>
</a>
<a href="./model_evaluation_model_catalogs" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_model_catalog.jpg" alt="MED Conda Environment"></img>
</div>
<div class="squared-card-text bold">Model Data Catalog</div>
</a>
</div>

### Supported Community Frameworks on Gadi

<div class="card-container">
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_ilamb" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/logo_ilamb.png" alt="ILAMB"></img>
</div>
<div class="squared-card-text bold">ILAMB</div>
</a>
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/logo_esmvaltool.png" alt="ESMValTool"></img>
</div>
<div class="squared-card-text bold">ESMValTool</div>
</a>
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/logo_cosima.png" alt="Pangeo/COSIMA"></img>
</div>
<div class="squared-card-text bold">COSIMA cookbook</div>
</a>
</div>

### Tools in development

We are currently setting up a range of tools that will help you to better evaluate and diagnose climate models:
* Model Diagnostics for on-the-fly analysis of your models at different snapshots
* Data format processing tools like APP4
* An Evaluation Recipe Gallery with searching functionality

While we are working on these, we have collected a number of links to existing tools in our [community tab](../community_resources/index.md) (note that we are not currating them).

{% include "call_contribute.md" %}

<!--
<div class="card-container">
<a href="./model_evaluation_getting_started/access_to_gadi_at_nci.md" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="..//assets/model_evaluation/Gadi-19-2.jpg" alt="Model Diagnostics"></img>
</div>
<div class="squared-card-text bold">Model Diagnostics</div>
</a>
<a href="./model_evaluation_data_processing.md" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_formatting.jpg" alt="A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/" title="Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/"></img>
</div>
<div class="squared-card-text bold">Data Format Processing</div>
</a>
<a href="./model_evaluation_recipe_gallery.md" class="squared-card default-text-color">
<div class="squared-card-image">
<img src="../assets/model_evaluation/model_evaluation_recipe.jpg" alt="A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipes" title="Image credit: https://github.com/COSIMA/cosima-recipes"></img>
</div>
<div class="squared-card-text bold">Evaluation Recipe Gallery</div>
</a>
</div> -->


<!-- THIS NEEDS TO BE DONE
## TBD: CMORisation
TBD: Raw data vs. curated data: CMORized vs. not! What does CMORized actually mean (look at ESMValTool documentation)?
TBD: Add APP4 to navigation (replace **Model Format Processing**?)
TBD: Tools to check if data is CMOR-compliant (raise issue)
TBD: Discuss with Dougie: How can we identify what is CMORized and what is not?
-->
Loading

0 comments on commit 3d89d13

Please sign in to comment.