-
Notifications
You must be signed in to change notification settings - Fork 11
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #428 from ACCESS-Hive/dev/sven/vars
Dev/sven/vars
- Loading branch information
Showing
34 changed files
with
414 additions
and
146 deletions.
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1,2 @@ | ||
???+ warning "The documentation on Hive is work in progress!" | ||
The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself. | ||
The ACCESS-Hive is a community resource that is a work in progress. We’d love to receive your contribution. Please see the [contributing guidelines](/contribute/index.md) below for how to make contributions to the **Hive** page content. You can also [open an issue](https://github.com/ACCESS-Hive/access-hive.github.io/issues) highlighting any content you’d like us to provide but aren’t able to contribute yourself. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
11 changes: 0 additions & 11 deletions
11
docs/community_resources/glossaries/glossary_access_nri.md
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,26 +1,122 @@ | ||
# Model Evaluation and Diagnostics (MED) | ||
|
||
Model evaluation is about measuring how fit for purpose a particular model is. | ||
|
||
If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). | ||
|
||
Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We provide [tools to process such data](./model_evaluation_data_processing.md) into a comparable format and a [gallery of recipes to evaluate](https://medportal.herokuapp.com/models/published) the formatted data. | ||
|
||
<table class="center"> | ||
<tr> | ||
<td width="24%"> | ||
<div align='center' width="100%" ><a href="./model_evaluation_observational_catalogs.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_obs_catalog.jpg" alt="A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images" title="Image credit: Wf Sihardian—EyeEm/Getty Images">Observational Data Catalog</img></a> | ||
</td> | ||
<td width="24%"> | ||
<div align='center' width="100%" ><a href="./model_evaluation_model_catalogs/index.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_model_catalog.jpg" alt="" >Model Data Catalog</img></a> | ||
</td> | ||
<td width="24%"> | ||
<div align='center' width="100%" ><a href="./model_evaluation_data_processing.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_formatting.jpg" alt="A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/" title="Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/">Data Format Processing</img></a> | ||
</td> | ||
<td width="24%"> | ||
<div align='center' width="100%" ><a href="./model_evaluation_recipe_gallery.md"><img align="center" width="90%" src="../assets/model_evaluation/model_evaluation_recipe.jpg" alt="A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipes" title="Image credit: https://github.com/COSIMA/cosima-recipes">Evaluation Recipe Gallery</img></a> | ||
</td> | ||
</tr> | ||
</table> | ||
|
||
Our vision: PLACEHOLDER FOR OUTCOME OF STAFF RETREAT | ||
# <div class="highlight-bg"> Model Evaluation and Diagnostics (MED) </div> | ||
|
||
<!-- Model evaluation is about measuring how fit for purpose a particular model is. --> | ||
|
||
## What is MED about? | ||
|
||
ACCESS-NRI's "Model Evaluation and Diagnostics" work is a critical facet of climate modeling, encompassing various tasks designed to ensure the model's reliability and accuracy. | ||
|
||
**Evaluation** involves scrutinizing the model through Model/Observation confrontations, checking its performance against real-world observations. It also includes experiment comparisons, testing the model under different scenarios, and inter-model comparisons like the Coupled Model Intercomparison Project (CMIP), assessing how the ACCESS-NRI model fares when compared with other climate models. | ||
|
||
**Diagnostics** involves constant monitoring of model runs to detect any anomalies or inconsistencies and a thorough analysis of outputs to verify the model's accuracy over time. | ||
|
||
## ACCESS-MED data and tools hosted on Gadi | ||
|
||
If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We also provide a number of [frameworks for model evaluation](./model_evaluation_on_gadi/index.md). We are also working on implementing more frameworks and recipes as well as formatting tools for a better model evaluation and diagnostics. | ||
|
||
### Getting Started | ||
<div class="card-container"> | ||
<a href="./model_evaluation_getting_started/access_to_gadi_at_nci" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="..//assets/model_evaluation/Gadi-19-2.jpg" alt="Computing Access"></img> | ||
</div> | ||
<div class="squared-card-text bold">Computing Access</div> | ||
</a> | ||
<a href="./model_evaluation_getting_started/model_evaluation_getting_started" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_conda.png" alt="MED Conda Environment"></img> | ||
</div> | ||
<div class="squared-card-text bold">MED Conda Environment</div> | ||
</a> | ||
<a href="./model_evaluation_getting_started/model_variables" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_variables.png" alt="Model Variables"></img> | ||
</div> | ||
<div class="squared-card-text bold">Model Variables</div> | ||
</a> | ||
</div> | ||
|
||
### Data Catalogs | ||
<div class="card-container"> | ||
<a href="./model_evaluation_observational_catalogs" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_obs_catalog.jpg" alt="A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images" title="Image credit: Wf Sihardian—EyeEm/Getty Images"></img> | ||
</div> | ||
<div class="squared-card-text bold">Observational Data Catalog</div> | ||
</a> | ||
<a href="./model_evaluation_model_catalogs" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_model_catalog.jpg" alt="MED Conda Environment"></img> | ||
</div> | ||
<div class="squared-card-text bold">Model Data Catalog</div> | ||
</a> | ||
</div> | ||
|
||
### Supported Community Frameworks on Gadi | ||
|
||
<div class="card-container"> | ||
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_ilamb" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/logo_ilamb.png" alt="ILAMB"></img> | ||
</div> | ||
<div class="squared-card-text bold">ILAMB</div> | ||
</a> | ||
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/logo_esmvaltool.png" alt="ESMValTool"></img> | ||
</div> | ||
<div class="squared-card-text bold">ESMValTool</div> | ||
</a> | ||
<a href="./model_evaluation_on_gadi/model_evaluation_on_gadi_pangeo_cosima" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/logo_cosima.png" alt="Pangeo/COSIMA"></img> | ||
</div> | ||
<div class="squared-card-text bold">COSIMA cookbook</div> | ||
</a> | ||
</div> | ||
|
||
### Tools in development | ||
|
||
We are currently setting up a range of tools that will help you to better evaluate and diagnose climate models: | ||
* Model Diagnostics for on-the-fly analysis of your models at different snapshots | ||
* Data format processing tools like APP4 | ||
* An Evaluation Recipe Gallery with searching functionality | ||
|
||
While we are working on these, we have collected a number of links to existing tools in our [community tab](../community_resources/index.md) (note that we are not currating them). | ||
|
||
{% include "call_contribute.md" %} | ||
|
||
<!-- | ||
<div class="card-container"> | ||
<a href="./model_evaluation_getting_started/access_to_gadi_at_nci.md" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="..//assets/model_evaluation/Gadi-19-2.jpg" alt="Model Diagnostics"></img> | ||
</div> | ||
<div class="squared-card-text bold">Model Diagnostics</div> | ||
</a> | ||
<a href="./model_evaluation_data_processing.md" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_formatting.jpg" alt="A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/" title="Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/"></img> | ||
</div> | ||
<div class="squared-card-text bold">Data Format Processing</div> | ||
</a> | ||
<a href="./model_evaluation_recipe_gallery.md" class="squared-card default-text-color"> | ||
<div class="squared-card-image"> | ||
<img src="../assets/model_evaluation/model_evaluation_recipe.jpg" alt="A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipes" title="Image credit: https://github.com/COSIMA/cosima-recipes"></img> | ||
</div> | ||
<div class="squared-card-text bold">Evaluation Recipe Gallery</div> | ||
</a> | ||
</div> --> | ||
|
||
|
||
<!-- THIS NEEDS TO BE DONE | ||
## TBD: CMORisation | ||
TBD: Raw data vs. curated data: CMORized vs. not! What does CMORized actually mean (look at ESMValTool documentation)? | ||
TBD: Add APP4 to navigation (replace **Model Format Processing**?) | ||
TBD: Tools to check if data is CMOR-compliant (raise issue) | ||
TBD: Discuss with Dougie: How can we identify what is CMORized and what is not? | ||
--> |
Oops, something went wrong.