Search NASA⌕ Search

Engineering topics

Guilyardi, Eric

Publications and source records attributed to Guilyardi, Eric.

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗

Robust evaluation of ENSO in climate models: How many ensemble members are needed?

Large ensembles of model simulations require considerable resources, and thus defining an appropriate ensemble size for a particular application is an important experimental design criterion. We estimate the ensemble size (N) needed to assess a model's ability to capture observed El Niño-Southern Oscillation (ENSO) behavior by utilizing the recently developed International CLIVAR ENSO Metrics Package (Planton et al., 2021). Using the larger ensembles available from CMIP6 and the US CLIVAR Large Ensemble Working Group, we find that larger ensembles are needed to robustly capture baseline ENSO characteristics (N > 50) and physical processes (N > 50) than the background climatology (N ≥ 12) and remote ENSO teleconnections (N ≥ 6). While these results vary somewhat across metrics and models, our study quantifies how larger ensembles are required to robustly evaluate simulated ENSO behavior, thereby providing some guidance for the design of model ensembles.

54 ENVIRONMENTAL SCIENCES↗

Decadal climate variability in the tropical Pacific: Characteristics, causes, predictability, and prospects

Decadal climate variability and change affects nearly every aspect of our world, including weather, agriculture, ecosystems, and the economy. Predicting its expression is thus of critical importance on multiple fronts. Power et al. review what is known about tropical Pacific decadal climate variability and change, the degree to which it can be simulated and predicted, and how we might improve our understanding of it. Here, more accurate projections will require longer and more detailed instrumental and paleoclimate records, improved climate models, and better data assimilation methods. —HJS.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged.

54 ENVIRONMENTAL SCIENCES↗

Human-induced changes to the global ocean water masses and their time of emergence

The World Ocean is rapidly changing, with global and regional modification of temperature and salinity, resulting in widespread and irreversible impacts. While the most pronounced observed temperature and salinity changes are located in the upper ocean, changes in water masses at depth have been identified and will probably strengthen in the future. In this study, using 11 climate models, we define when anthropogenic temperature and salinity changes are expected to emerge from natural variability in the ocean interior along density surfaces. The models predict that in 2020, 20–55% of the Atlantic, Pacific and Indian basins have an emergent anthropogenic signal; reaching 40–65% in 2050 and 55–80% in 2080. The well-ventilated Southern Ocean water masses emerge very rapidly, as early as the 1980–1990s, while the Northern Hemisphere water masses emerge in the 2010–2030s. Our results highlight the importance of maintaining and augmenting an ocean observing system capable of detecting and monitoring persistent anthropogenic changes.

54 ENVIRONMENTAL SCIENCES↗