Earth System Model Evaluation Tool (ESMValTool) v2.0-an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP
| Type | Article | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Date | 2020-07 | ||||||||||||
| Language | English | ||||||||||||
| Author(s) | Eyring Veronika 1, 2, Bock Lisa1, Lauer Axel1, Righi Mattia1, Schlund Manuel1, Andela Bouwe3, Arnone Enrico4, 5, Bellprat Omar6, Broetz Bjorn1, Caron Louis-Philippe6, Carvalhais Nuno7, 8, Cionni Irene9, Cortesi Nicola6, Crezee Bas10, Davin Edouard L.10, Davini Paolo4, Debeire Kevin1, de Mora Lee11, Deser Clara12, Docquier David13, Earnshaw Paul14, Ehbrecht Carsten15, Gier Bettina K.1, 2, Gonzalez-Reviriego Nube6, Goodman Paul16, Hagemann Stefan17, Hardiman Steven14, Hassler Birgit1, Hunter Alasdair6, Kadow Christopher15, 18, Kindermann Stephan15, Koirala Sujan7, Koldunov Nikolay19, 20, Lejeune Quentin10, 21, Lembo Valerio22, Lovato Tomas23, Lucarini Valerio22, 24, 25, Massonnet Francois26, Mueller Benjamin27, Pandde Amarjiit16, Perez-Zanon Nuria6, Phillips Adam12, Predoi Valeriu28, Russell Joellen16, Sellar Alistair14, Serva Federico29, Stacke Tobias17, 30, Swaminathan Ranjini31, Torralba Veronica6, Vegas-Regidor Javier6, von Hardenberg Jost4, 32, Weigel Katja1, 2, Zimmermann Klaus13 |
||||||||||||
| Affiliation(s) | 1 : Deutsch Zentrum Luft & Raumfahrt, Inst Phys Atmosphere, Oberpfaffenhofen, Germany. 2 : Univ Bremen, Inst Environm Phys IUP, Bremen, Germany. 3 : Netherlands eSci Ctr, Sci Pk 140, NL-1098 XG Amsterdam, Netherlands. 4 : Consiglio Nazl Ric ISAC CNR, Inst Atmospher Sci & Climate, Turin, Italy. 5 : Univ Torino, Dept Phys, Turin, Italy. 6 : Barcelona Supercomp Ctr BSC, Barcelona, Spain. 7 : Max Planck Inst Biogeochem, Dept Biogeochem Integrat, Jena, Germany. 8 : Univ Nova Lisboa, DCEA, FCT, P-2829516 Caparica, Portugal. 9 : Agenzia Nazl Nuove Tecnol Energia & Sviluppo Econ, Rome, Italy. 10 : Swiss Fed Inst Technol, Inst Atmospher & Climate Sci, Zurich, Switzerland. 11 : Plymouth Marine Lab PML, Plymouth, Devon, England. 12 : Natl Ctr Atmospher Res NCAR, Boulder, CO USA. 13 : Swedish Meteorol & Hydrol Inst SMHI, Rossby Ctr, Norrkoping, Sweden. 14 : Met Off, Exeter, Devon, England. 15 : Deutsch Klimarechenzentrum, Hamburg, Germany. 16 : Univ Arizona, Dept Geosci, Tucson, AZ 85721 USA. 17 : Helmholtz Zentrum Geesthacht HZG, Inst Coastal Res, Geesthacht, Germany. 18 : Freie Univ Berlin FUB, Berlin, Germany. 19 : Ctr Marine Environm Sci, MARUM, Bremen, Germany. 20 : Helmholtz Zentrum Polar & Meeresforsch, Alfred Wegener Inst, Bremerhaven, Germany. 21 : Climate Analyt, Berlin, Germany. 22 : Univ Hamburg, Meteorol Inst, CEN, Hamburg, Germany. 23 : Fdn Ctr Euro Mediterraneo Cambiamenti Climat CMCC, Bologna, Italy. 24 : Univ Reading, Dept Math & Stat, Reading, Berks, England. 25 : Univ Reading, Ctr Math Planet Earth, Dept Math & Stat, Reading, Berks, England. 26 : Catholic Univ Louvain, Earth & Life Inst, Georges Lemaitre Ctr Earth & Climate Res, Louvain La Neuve, Belgium. 27 : Ludwig Maximilians Univ LMU, Dept Geog, Munich, Germany. 28 : Univ Reading, NCAS Computat Modelling Serv CMS, Reading, Berks, England. 29 : Consiglio Nazl Ric ISMAR CNR, Inst Marine Sci, Rome, Italy. 30 : Max Planck Inst Meteorol MPI M, Hamburg, Germany. 31 : Univ Reading, Dept Meteorol, Reading, Berks, England. 32 : Politecn Torino, Dept Environm Land & Infrastruct Engn, Turin, Italy. |
||||||||||||
| Source | Geoscientific Model Development (1991-959X) (Copernicus Gesellschaft Mbh), 2020-07 , Vol. 13 , N. 7 , P. 3383-3438 | ||||||||||||
| DOI | 10.5194/gmd-13-3383-2020 | ||||||||||||
| WOS© Times Cited | 64 | ||||||||||||
| Abstract | The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top-down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5. | ||||||||||||
| Full Text |
|