Search NASA⌕ Search

SEARCH · Search NASA

Results for “ESM”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A Comprehensive Analysis of Uncertainties in Warm-Rain Parameterizations in Climate Models Based on In Situ Measurements

Abstract Because of the coarse grid size of Earth system models (ESMs), representing warm-rain processes in ESMs is a challenging task involving multiple sources of uncertainty. Previous studies evaluated warm-rain parameterizations mainly according to their performance in emulating collision–coalescence rates for local droplet populations over a short period of a few seconds. The representativeness of these local process rates comes into question when applied in ESMs for grid sizes on the order of 100 km and time steps on the order of 20–30 min. We evaluate several widely used warm-rain parameterizations in ESM application scenarios. In the comparison of local and instantaneous autoconversion rates, the two parameterization schemes based on numerical fitting to stochastic collection equation (SCE) results perform best. However, because of Jessen’s inequality, their performance deteriorates when grid-mean, instead of locally resolved, cloud properties are used in their simulations. In contrast, the effect of Jessen’s inequality partly cancels the overestimation problem of two semianalytical schemes, leading to an improvement in the ESM-like comparison. In the assessment of uncertainty due to the large time step of ESMs, it is found that the rainwater tendency simulated by the SCE is roughly linear for time steps smaller than 10 min, but the nonlinearity effect becomes significant for larger time steps, leading to errors up to a factor of 4 for a time step of 20 min. After considering all uncertainties, the grid-mean and time-averaged rainwater tendency based on the parameterization schemes is mostly within a factor of 4 of the local benchmark results simulated by SCE.

Meteorology & Atmospheric Sciences↗

Observational benchmarks inform representation of soil organic carbon dynamics in land surface models

Abstract. Representing soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon–climate feedbacks. Machine learning models can help identify dominant environmental controllers and establish their functional relationships with SOC stocks. The resulting knowledge can be integrated into ESMs to reduce uncertainty and improve predictions of SOC dynamics over space and time. In this study, we used a large number of SOC field observations (n=54 000), geospatial datasets of environmental factors (n=46), and two machine learning approaches (namely random forest, RF, and generalized additive modeling, GAM) to (1) identify dominant environmental controllers of global and biome-specific SOC stocks, (2) derive functional relationships between environmental controllers and SOC stocks, and (3) compare the identified environmental controllers and predictive relationships with those in models used in Phase 6 of the Coupled Model Intercomparison Project (CMIP6). Our results showed that the diurnal temperature, drought index, cation exchange capacity, and precipitation were important observed environmental predictors of global SOC stocks. While the RF model identified 14 environmental factors that describe climatic, vegetation, and edaphic conditions as important predictors of global SOC stocks (R2=0.61, RMSE = 0.46 kg m−2), current ESMs oversimplify the relationships between environmental factors and SOC, with precipitation, temperature, and net primary productivity explaining > 96 % of the variability in ESM-modeled SOC stocks. Further, our study revealed notable disparities among the functional relationships between environmental factors and SOC stocks simulated by ESMs compared with observed relationships. To improve SOC representations in ESMs, it is imperative to incorporate additional environmental controls, such as the cation exchange capacity, and refine the functional relationships to align more closely with observations.

54 ENVIRONMENTAL SCIENCES↗

A Fortran–Python interface for integrating machine learning parameterization into earth system models

Abstract. Parameterizations in earth system models (ESMs) are subject to biases and uncertainties arising from subjective empirical assumptions and incomplete understanding of the underlying physical processes. Recently, the growing representational capability of machine learning (ML) in solving complex problems has spawned immense interests in climate science applications. Specifically, ML-based parameterizations have been developed to represent convection, radiation, and microphysics processes in ESMs by learning from observations or high-resolution simulations, which have the potential to improve the accuracies and alleviate the uncertainties. Previous works have developed some surrogate models for these processes using ML. These surrogate models need to be coupled with the dynamical core of ESMs to investigate the effectiveness and their performance in a coupled system. In this study, we present a novel Fortran–Python interface designed to seamlessly integrate ML parameterizations into ESMs. This interface showcases high versatility by supporting popular ML frameworks like PyTorch, TensorFlow, and scikit-learn. We demonstrate the interface's modularity and reusability through two cases: an ML trigger function for convection parameterization and an ML wildfire model. We conduct a comprehensive evaluation of memory usage and computational overhead resulting from the integration of Python codes into the Fortran ESMs. By leveraging this flexible interface, ML parameterizations can be effectively developed, tested, and integrated into ESMs.

54 ENVIRONMENTAL SCIENCES↗

A Fortran-Python Interface for Integrating Machine Learning Parameterization into Earth System Models

Parameterizations in Earth System Models (ESMs) are subject to biases and uncertainties arising from subjective empirical assumptions and incomplete understanding of the underlying physical processes. Recently, the growing representational capability of machine learning (ML) in solving complex problems has spawned immense interests in climate science applications. Specifically, ML-based parameterizations have been developed to represent convection, radiation and microphysics processes in ESMs by learning from observations or high-resolution simulations, which have the potential to improve the accuracies and alleviate the uncertainties. Previous works have developed some surrogate models for these processes using ML. These surrogate models need to be coupled with the dynamical core of ESMs to investigate the effectiveness and their performance in a coupled system. In this study, we present a novel Fortran-Python interface designed to seamlessly integrate ML parameterizations into ESMs. This interface showcases high versatility by supporting popular ML frameworks like PyTorch, TensorFlow, and Scikit-learn. We demonstrate the interface's modularity and reusability through two cases: a ML trigger function for convection parameterization and a ML wildfire model. We conduct a comprehensive evaluation of memory usage and computational overhead resulting from the integration of Python codes into the Fortran ESMs. By leveraging this flexible interface, ML parameterizations can be effectively developed, tested, and integrated into ESMs.

54 ENVIRONMENTAL SCIENCES↗

Electron-impact ionization from excited states method

We present a distorted-wave with exchange (DWE) formulation for computing electron-impact ionization (EII) cross sections within the recently developed excited states method (ESM) for plasmas. The ESM provides a self-consistent quantum-mechanical description of both bound and continuum electronic states in dense plasmas, incorporating finite-temperature and screening effects absent in isolated-atom approaches. Using this framework, we calculate EII cross sections for lithium across a wide range of temperatures and densities. We show that the ESM reproduces the isolated-atom limit at low densities while capturing strong plasma effects, such as pressure ionization and shape resonances, at solid density. Comparisons with isolated-atom DWE and average-atom (AA) calculations reveal that, although AA cross sections can approximate configuration average behavior, the ESM provides more accurate, state-resolved answers. In conclusion, these results demonstrate that the ESM allows one to obtain rate coefficients for collisional-radiative modeling of plasmas out of local thermodynamical equilibrium.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Climate impacts in scenarios: time to close the loop?

Reaching a full understanding of the consequences of climate change for society and ecosystems, and the ensuing needs for adaptation, requires a consideration of the interactions between human and Earth systems. Currently, however, climate research largely separates the influence of society on climate from the influence of climate on society; that is, it doesn’t “close the loop.” A primary example of this approach is the generation and use of earth system model (ESM) simulations in the climate change research community. Large-scale socio-economic models, known as integrated assessment models (IAMs), are used to project emissions and land use change which serve as input to ESMs. ESM projections then serve as input to models of impacts on society and ecosystems. But, according to this modeling chain, those impacts do not affect the emissions and land use that drove the ESMs in the first place. Previous work has not drawn firm conclusions on whether this feedback would be large enough to warrant explicitly accounting for it. Two prominent possibilities, however, are that emissions and land use scenarios representing the high and low ends of the plausible range of future climate change are both too extreme. The high-end scenario may miss damaging impacts that would reduce economic activity, and therefore emissions, while the low-end scenario may ignore climate feedbacks that would make large-scale land-based carbon removal ineffective and therefore would hamper mitigation at the level assumed by the scenario. In this piece, we identify the opportunities and challenges that implementing such feedback loops would face. We argue that recent developments in climate impact research, human system modeling and ESM emulation make the time ripe to use IAMs in a structured model intercomparison exercise. Model intercomparison projects have benefitted the climate modeling community for decade snow, and more recently have also benefitted the impact modeling community. An IAM intercomparison focused on integrating impacts could make large strides in testing the implications of these feedbacks and assessing whether closing the loop would fundamentally change our outlook on future climate changes and their consequences.

Tebaldi, Claudia↗

Overview of the Nephele Perturbed Parameter Ensemble for Aerosol‐Cloud Interactions in E3SMv3

Aerosol-cloud interactions (aci) are the leading source of uncertainty in inferring climate sensitivity from the historical record. Earth system models (ESMs) struggle to represent aci because the processes responsible for these phenomena occur at much finer time and space scales than can be resolved by any ESM. Observational constraints provide key benchmarks to test ESMs, but cannot be used alone to fully understand aci processes except in very specific cases where causality is controlled; some degree of modeling is required to infer aci and estimate radiative forcing. Here, we generate and characterize a perturbed parameter ensemble (PPE) in version 3 of the Energy Exascale ESM (E3SMv3). We perturb 25 parameters that govern aci processes over 250 members and integrate the model over present-day and preindustrial aerosol emissions. We find that the process representation in E3SMv3 is flexible and can generate global-mean effective radiative forcings due to aci (ERFaci) ranging from −3.0 to +0.9 W m −2 . The positive ERFaci values simulated by a portion of the PPE are implausible and result from parameter combinations that produce unrealistic top-of-atmosphere energy fluxes. While global-mean cloud droplet number concentration always increases in response to anthropogenic aerosol, cloud liquid water path can both increase and decrease, suggesting that precipitation suppression is not the only aerosol-cloud adjustment represented by E3SMv3. Analysis of which processes control liquid cloud adjustment in the PPE points toward stratiform precipitation processes and aerosol activation, which is consistent with many previous ESMs, as well as the new two-moment convective cloud microphysics in E3SMv3.

Nugent, Jacqueline M. [Univ. of Wyoming, Laramie, ↗

High-Resolution WRF-Based Downscaling of Earth System Model Projections for Energy Applications across CONUS

Evaluating energy resources under future scenarios requires meteorological information that adequately resolves regional-scale variability and is suitable for regional energy system studies. Although Earth system model (ESM) outputs provide essential large-scale context, their coarse resolution and inherent biases limit direct use in energy system applications. This work presents a high-resolution dynamical downscaling framework using the Weather Research and Forecasting (WRF) model to generate energy-relevant regional fields for future scenarios over the contiguous United States (CONUS). The framework first identifies an optimal WRF configuration through sensitivity experiments, then evaluates raw and bias-corrected ESM initial and boundary conditions, with soil moisture and soil temperature bias correction implemented as an integral component of the bias-corrected ESM atmospheric forcing prior to WRF dynamical downscaling to improve land-atmosphere interactions. Simulations performed at 4-km resolution show that uncorrected ESM forcing leads to systematically dry and cold soil states, which propagate into elevated near-surface air temperature and solar irradiance biases, particularly during summer for the period 2000-2014. Incorporating bias-corrected atmospheric forcing together with soil state bias correction substantially reduces these errors and improves the representation of surface energy processes in WRF simulations. The results highlight the importance of bias-aware initialization strategies in high-resolution dynamical downscaling for future energy system analysis and planning.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Second-generation downscaled earth system model data using generative machine learning

The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. As with the first Sup3rCC version, the data still include temperature, wind speed and direction at multiple heights, pressure, three components of downwelling solar radiation, and relative humidity—all at 4-kilometer (km) hourly resolution over the contiguous United States. This is a 25x spatial enhancement and 24x temporal enhancement of the source 100-km daily-average ESM data. This extension of the Sup3rCC dataset includes data from six ESMs from two shared socioeconomic pathways (SSPs) totaling 400 years of data with multiple future projections of changing meteorological conditions. The scenario selection was based on a structured evaluation of historical ESM skill and comprehensive representation of possible trajectories of future climate change in temperature, humidity, precipitation, solar irradiance, and near-surface wind speeds. The inclusion of multiple future projections is intended to enable users to assess key drivers of un 36 certainty and variability. All data are double-bias corrected, resulting in a product that can be used out-of-the-box for energy system analysis with minimal historical bias. The potential applications of Sup3rCC data extend to various topics in renewable energy resource assessment, energy systems modeling, and grid resilience studies. High-resolution future meteorological projections are critical for evaluating the effects of changing meteorological conditions on renewable energy generation, energy demand, and for optimizing energy storage and grid infrastructure. The 4-km hourly resolution of the downscaled data enables understanding of spatial and temporal variability at the scales necessary for energy system operational planning. In addition, the dataset can support risk assessments by providing detailed information on possible future extreme weather events and long-term meteorological variability at scales relevant to energy infrastructure. By offering an enhanced representation of possible future meteorological conditions, the second-generation Sup3rCC dataset enables more precise modeling of energy resilience and adaptation strategies in response to changing meteorological conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Recommendations for Comprehensive and Independent Evaluation of Machine Learning‐Based Earth System Models

Abstract Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics‐based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop Earth‐system models (ESMs) capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes over long timescales. Building trust in ESMs is a much more difficult problem than for weather forecast models, not least because the model must represent the alternate (e.g., future or paleoclimatic) coupled states of the system for which there are no direct observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML‐based models, demonstrating the credibility of ML‐based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML‐based ESMs to strengthen their credibility and promote their wider use.

54 ENVIRONMENTAL SCIENCES↗

A Comparative Study of Physics‐Informed and Data‐Driven Neural Networks for Compound Flood Simulation at River‐Ocean Interfaces: A Case Study of Hurricane Irene

Simulating compound flooding (CF) at the river-ocean interface within large-scale Earth System Models (ESMs) presents significant challenges due to complex interactions between river discharge, storm surge, and tides. This study assesses the comparative advantages of physics-informed and data-driven machine learning (ML) approaches for enhancing local ESM performance. We systematically compare data-driven neural network models (i.e., CNNs, U-Net, Long Short-Term Memory (LSTM), Gated Recurrent Unit), and physics-informed neural network (PINN) models, including vanilla PINN and a finite-difference-based PINN (FD-PINN). Specifically, FD-PINN is introduced to enhance computational efficiency, accelerating vanilla PINNs by ∼6.5 times while improving accuracy. To enhance data-driven model training, a new data-generation approach is developed to sample historical fluvial and coastal flood events, which ensures a robust data set for extreme event prediction. The models are evaluated using a realistic one-dimensional river domain extracted from an ESM's river mesh and the Hurricane Irene event as an independent test case. Results show that FD-PINN achieves accurate predictions with significantly reduced computational costs relative to vanilla PINNs. Among data-driven models, the best overall performance is achieved by a CNN-LSTM hybrid, which balances accuracy and efficiency. While a fully connected CNN (CNN-FC) provides the best accuracy, it incurs high computational cost. Architectures lacking strong temporal modeling tend to underperform on unseen events. These findings highlight the importance of sequence-aware designs for robust generalization. This study reveals the trade-offs between physics-informed and data-driven models and proposes an adaptive hybrid framework for integrating ML into ESMs to enhance local flood simulations.

Earth Systems Modeling↗

Projected runoff declines from plant physiological effects on precipitation

Abstract The impact of plants on runoff under high atmospheric CO 2 is a major uncertainty for future water resources. Theory and Earth system models (ESMs) suggest that stricter plant stomatal regulation under high CO 2 will reduce transpiration, potentially boosting runoff. Yet, across a 12-member ensemble of idealized ESM simulations that isolate plant responses to CO 2 , we show that lower transpiration robustly enhances runoff over only 5% of modelled global land area. Precipitation changes are five times more important than transpiration changes in driving runoff responses and are a significant signal of CO 2 physiological forcing over 31–57% of land areas across models. Crucially, ESMs largely disagree on where physiologically forced precipitation changes occur but agree that plant responses in most locations are as likely to reduce runoff as increase it. These results imply that large model uncertainties in precipitation responses, rather than transpiration responses, explain why ESMs disagree on plant physiologically driven runoff changes.

Lesk, Corey S. (ORCID:0000000308684040)↗

Global models predict clouds at the wrong time of day: Does it matter for radiation and climate?

Accurate prediction of future climate change hinges upon the ability of Earth system models (ESMs) to simulate clouds and their radiative effects. Even if an ESM can simulate the correct clouds, a systematic error in the amount of sunlight reflected by clouds (and, thus, cloud radiative effect) can exist if the clouds are simulated at the incorrect time of day. In this work, we develop an analytical model connecting diurnal cloud biases to emergent mean state radiative biases. With the use of satellite observations, we demonstrate that there are errors in the time of day that clouds are occurring in ESMs that would cause bias in shortwave cloud radiative effect (SWCRE) that is greater than 45% of the total SWCRE bias, but such errors in the cloud diurnal cycle are masked by other compensating errors, indicating that these ESMs are getting the right answer for the wrong reasons.

Geosciences↗

Priorities, opportunities, and challenges for integrating microorganisms into Earth system models for climate change prediction

ABSTRACT Climate change jeopardizes human health, global biodiversity, and sustainability of the biosphere. To make reliable predictions about climate change, scientists use Earth system models (ESMs) that integrate physical, chemical, and biological processes occurring on land, the oceans, and the atmosphere. Although critical for catalyzing coupled biogeochemical processes, microorganisms have traditionally been left out of ESMs. Here, we generate a “top 10” list of priorities, opportunities, and challenges for the explicit integration of microorganisms into ESMs. We discuss the need for coarse-graining microbial information into functionally relevant categories, as well as the capacity for microorganisms to rapidly evolve in response to climate-change drivers. Microbiologists are uniquely positioned to collect novel and valuable information necessary for next-generation ESMs, but this requires data harmonization and transdisciplinary collaboration to effectively guide adaptation strategies and mitigation policy.

Microbiology↗

West African Monsoon System’s Responses to Global Ocean–Regional Atmosphere Coupling

This study explores the added value (AV) of a regional Earth system model (ESM) compared to an atmosphere-only regional climate model (RCM) in simulating West African monsoon (WAM) rainfall. The primary goals are to foster discussions on the suitability of coupled RCMs for WAM projections and deepen our understanding of ocean–atmosphere coupling’s influence on the WAM system. The study employs results from dynamical downscaling of the ERA-Interim reanalysis and Max Plank Institute ESM, low resolution (MPI-ESM-LR), by two RCMs, atmosphere only (REMO) and REMO coupled with Max Planck Institute Ocean Model (MPIOM) (ROM), at ~25-km horizontal resolution. Results show that in regions distant from coupling domain boundaries such as West Africa (WA), constraint conditions from ERA-Interim are more beneficial than coupling effects. REMO, reliant on oceanic sea surface temperatures (SSTs) from observations and influenced by ERA-Interim, is biased under coupling conditions, although coupling offers potential advantages in representing heat and mass fluxes. Contrastingly, as intended, coupling improves SSTs and monsoon fluxes’ relationships under ESM-forced conditions. In this latter case, the coupling features a dipole-like spatial structure of AV, improving precipitation over the Guinea Coast but degrading precipitation over half of the Sahel. Our extensive examination of physical processes and mechanisms underpinning the WAM system supports the plausibility of AV. Additionally, we found that the monsoonal dynamics over the ocean respond to convective activity, with the Sahara–Sahel surface temperature gradient serving as the maintenance mechanism. While further efforts are needed to enhance the coupled RCM, we advocate for its use in the context of WAM rainfall forecasts and projections.

54 ENVIRONMENTAL SCIENCES↗

Warm-phase microphysical evolution in large-eddy simulations of tropical cumulus congestus: evaluating drop size distribution evolution using polarimetry retrievals, in situ measurements, and a thermal-based framework

Owing to uncertainties in convective microphysics processes, improving parameterizations in Earth system models (ESMs) can benefit from observationally constrained cases suitable for scaling between cloud-resolving models and ESMs. We propose a benchmark large-eddy simulation (LES) cumulus congestus case study from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP 2 Ex) for evaluating and improving ESMs in single-column model (SCM) mode. We seek observational constraints using novel polarimetric retrievals and in situ cloud microphysics measurements. Simulations using bulk and bin microphysics initialized with observed aerosol profiles are compared to cloud-top retrievals of cloud droplet effective radius (R eff ), effective variance (ν eff ), and number concentration (N d ) from the airborne Research Scanning Polarimeter (RSP). Both schemes reproduce characteristics of cloud-top N d and R eff that increase and decrease with altitude, respectively. Cloud-top N d is low-biased relative to RSP retrievals in both schemes, potentially due to limitations in both simulations and retrieval assumptions. Cloud-top R eff is low-biased in the bulk scheme but reasonably reproduced by the bin scheme. Profiles of N d and R eff are sensitive to the collision–coalescence process and the vertical variation in aerosol size distribution. Comparison of simulated and in situ droplet size distributions (DSDs) shows that, to first order, integrated moments are always sensitive to sizes < ~ 30 µm and can also be sensitive to larger sizes if the DSDs are sufficiently broad, with implications for the assumed maximum observed size retrieved by the RSP. The bin scheme captures the observed extended tail of the DSD, while the bulk scheme is unable to due to parametric constraints. Differences in expected relationships between in situ measurements of cloud cores and cloud-top retrievals by RSP demonstrate difficulty in constraining well the case presented herein. Finally, a thermal-tracking framework demonstrates that the dilution of N d throughout a thermal's lifetime is heavily determined by collision–coalescence and the height-varying aerosol distribution and that, in the absence of these, the impact of entrainment on diluting N d is largely offset by secondary activation. Implications for evaluating warm-phase convective microphysics schemes in ESMs and translating results for use on global, space-based polarimetry platforms are discussed.

Stanford, McKenna Wallace [Columbia Univ., New Yor↗

The relative importance of wind and hydroclimate drivers in modulating the interannual variability of dust emissions in Earth system models

Windblown dust emissions are controlled by near-surface wind speed and sediment erodibility, the latter modulated by hydroclimate and land-use conditions. Accurate representations of these drivers are critical for reproducing historical dust variability and projecting future dust changes in Earth system models (ESMs). This study examines the discrepancies among 21 ESMs in the relative importance of wind speed versus five hydroclimate drivers in explaining the historical (1980–2014) variability of dust emissions from global drylands. In hyperarid areas, models show poor agreement in the simulated dust variability, with only 9 % out of 210 inter-model comparisons exhibiting significant positive correlations. In contrast, arid and semiarid areas exhibit a dual pattern driven by a “double-edged sword” effect of land surface memory: models with coherent hydroclimate variability show better agreement, whereas those with divergent hydroclimate representations show larger disagreement. While the ESMs capture the dominant role of wind speed in hyperarid areas, they diverge markedly in the relative contributions of wind and hydroclimate drivers in arid and semiarid areas. Replacing the Zender et al. (2003) dust scheme with the Kok et al. (2014) scheme in CESM and E3SM generally strengthens hydroclimate influences while reducing wind speed contributions to simulated dust variability. MERRA-2 reanalysis produces stronger wind influences than most ESMs across all dryland regions. These results underscore the need for improved near-surface wind simulations in hyperarid areas and more realistic land surface and hydroclimate representations in arid and semiarid areas to reduce uncertainties in global dust emission simulations.

Li, Xinzhu [Michigan Technological University, Hou↗

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗