Search NASA⌕ Search

SEARCH · Search NASA

Results for “intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Mesoscale Convective Systems Tracking Method Intercomparison (MCSMIP): Application to DYAMOND Global km‐Scale Simulations

Abstract Global kilometer‐scale models represent the future of Earth system modeling, enabling explicit simulation of organized convective storms and their associated extreme weather. Here, we comprehensively evaluate tropical mesoscale convective system (MCS) characteristics in the DYAMOND (DYnamics of the atmospheric general circulation modeled on non‐hydrostatic domains) simulations for both summer and winter phases. Using 10 different feature trackers applied to simulations and satellite observations, we assess MCS frequency, precipitation, and other key characteristics. Substantial differences (a factor of 2–3) arise among trackers in observed MCS frequency and their precipitation contribution, but model‐observation differences in MCS statistics are more consistent across trackers. DYAMOND models are generally skillful in simulating tropical mean MCS frequency, with multi‐model mean biases ranging from −2%–8% over land and −8%–8% over ocean (summer vs. winter). However, most DYAMOND models underestimate MCS precipitation amount (23%) and their contribution to total precipitation (17%). Biases in precipitation contributions are generally smaller over land (13%) than over ocean (21%), with moderate inter‐model variability. While models better simulate MCS diurnal cycles and cloud shield characteristics, they overestimate MCS precipitation intensity and underestimate stratiform rain contributions (up to a factor of 2), particularly over land, albeit observational uncertainties exist. Additionally, models exhibit a wide range of precipitable water in the tropics compared to reanalysis and satellite observations, with many models showing exaggerated sensitivity of MCS precipitation intensity to precipitable water. The MCS metrics developed here provide process‐oriented diagnostics to guide future model development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Intercomparison of sensible and latent heat flux measurements from combined eddy covariance, energy balance, and Bowen ratio methods above a grassland prairie

We present a comparison of four different methods of measuring sensible (H) and latent (LE) heat fluxes for a year over a mixed grass prairie ecosystem in the Nebraska SandHills [eddy covariance (EC), energy balance/Bowen ratio (EBBR), residual energy (RES), modified Bowen ratio (MBR) methods]. Additionally, we developed a set of quality control criteria for each method and present a simplification to the traditional EBBR setup. Using EC as reference, all methods yielded similar estimates of yearly H (regression slopes (m) ~ 2% from unity; H EC > H EBBR , H RES , and H MBR ). For yearly LE, EBBR and RES yielded similar estimates with EC (m ~ 2% from unity; LE EC < LE EBBR and LE RES ), while a larger bias was found from MBR (m ~ 8% from unity; LE EC > LE MBR ). At shorter time scales (~ hourly), moderate scatter was found about linear regression fits for H between EBBR and EC (R 2 = 0.81), with smaller scatter between RES and MBR, and EC (R 2 = 0.91). For LE, smaller scatter was also measured between EC, and EBBR and RES (R 2 = 0.89 and 0.87, respectively), with the larger scatter between EC and MBR (R 2 = 0.65). This suggests methods other than EC may be well suited to longer-term applications (≥ yearly), but have larger uncertainty on individual measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A protocol for model intercomparison of impacts of marine cloud brightening climate intervention

A modeling protocol (defined by a series of climate model simulations with specified model output) is introduced. Studies using these simulations are designed to improve the understanding of climate impacts using a strategy for climate intervention (CI) known as marine cloud brightening (MCB) in specific regions; therefore, the protocol is called MCB-REG (where REG stands for region). The model simulations are not intended to assess consequences of a realistic MCB deployment intended to achieve specific climate targets but instead to expose responses to interventions in six regions with pervasive cloud systems that are often considered candidates for such a deployment. A calibration step involving simulations with fixed sea surface temperatures (SSTs) is first used to identify a common forcing, and then coupled simulations with forcing in individual regions and combinations of regions are used to examine climate impacts. Synthetic estimates constructed by superposing responses from simulations with forcing in individual regions are considered a means of approximating the climate impacts produced when MCB interventions are introduced in multiple regions. A few results comparing simulations from three modern climate models (CESM2, E3SMv2, and UKESM1) are used to illustrate the similarities and differences between model behavior and the utility of estimates of MCB climate responses that were synthesized by summing responses introduced in individual regions. Cloud responses to aerosol injections differ substantially between models (CESM2 clouds appear much more susceptible to aerosol emissions than the other models), but patterns in precipitation and surface temperature responses were similar when forcing is imposed with similar amplitudes in the same regions. A previously identified La Niña-like response to forcing introduced in the Southeast Pacific is evident in this study, but the amplitude of the response was shown to markedly differ across the three models. Other common response patterns were also found and are discussed. Forcing in the Southeast Atlantic consistently (across all three models) produces weaker global cooling than that in other regions, and the Southeast Pacific and South Pacific show the strongest cooling. This indicates that the efficiency of a given intervention depends on not only the susceptibility of the clouds to aerosol perturbations, but also the strength of the underlying radiative feedbacks and ocean responses operating within each region. These responses were generally robust across models, but more studies and an examination of responses with ensembles would be beneficial.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A protocol and analysis of year-long simulations of global storm-resolving models and beyond

We propose a protocol to evaluate and analyze year-long simulations of global storm-resolving models (GSRMs). The proposed protocol complements an earlier 40-day simulation protocol under the DYAMOND (DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains) project to allow the analysis of the seasonal cycle and associated climatic relevant phenomena. This intercomparison aims to reveal how GSRMs, which can simulate mesoscale convective systems (MCSs) in the global domain, reproduce atmospheric large-scale structures related to convection beyond month-long simulations. The intercomparison for one-year simulations is conducted by either atmosphere-only models or atmosphere–ocean coupled models with atmospheric horizontal mesh sizes less than 5 km. We recommend the continuous four seasons from March 2020 to February 2021 as a target period for the intercomparison but with options for many groups to join more flexibly. The output variables are collected at 0.25° resolution, and archives of a small set of native grid variables are encouraged to analyze tropical cyclones and MCSs. Through the proposed global storm-resolving simulation, we will evaluate the climatological distributions of the atmospheric large-scale circulations, such as the Intertropical Convergence Zone (ITCZ), monsoon, midlatitude jets, their time evolution, and the upscale impacts on them. We present sample analyses from a one-year simulation using the 3.5 km mesh Nonhydrostatic Icosahedral Atmospheric Model (NICAM), revealing the realistic zonal contrast of tropical precipitation, no double ITCZ structure, the reasonable midlatitude jet position and intensity but a weak bias of storm track activities, and a warm bias over the Eurasia during boreal winter. We also clarify the cross-scale interaction, such as the effects of cold pools on mean precipitation over the Maritime Continent through the precipitation diurnal cycle and the effects of resolved gravity waves on midlatitude mean flows. The proposed one-year simulation protocol is referred to as the “Sendai Protocol.” This protocol is not unique or definite for evaluating GSRMs; we prospect a hierarchical set of experiments from short-term to multi-year simulations as GSRM intercomparisons.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Implementation and Exploration of Parameterizations of Large-Scale Dynamics in NCAR's Single Column Atmosphere Model SCAM6

A single column model with parameterized large-scale (LS) dynamics is used to better understand the response of steady-state tropical precipitation to relative sea surface temperature under various representations of radiation, convection, and circulation. The large-scale dynamics are parametrized via the weak temperature gradient (WTG), damped gravity wave (DGW), and spectral weak temperature gradient (Spectral WTG) method in NCAR's Single Column Atmosphere Model (SCAM6). Radiative cooling is either specified or interactive, and the convective parameterization is run using two different values of a parameter that controls the degree of convective inhibition. Results are interpreted in the context of the Global Atmospheric System Studies -Weak Temperature Gradient (GASS-WTG) Intercomparison project. Using the same parameter settings and simulation configuration as in the GASS-WTG Intercomparison project, SCAM6 under the WTG and DGW methods produces erratic results, suggestive of numerical instability. However, when key parameters are changed to weaken the large-scale circulation's damping of tropospheric temperature variations, SCAM6 performs comparably to single column models in the GASS-WTG Intercomparison project. The Spectral WTG method is less sensitive to changes in convection and radiation than are the other two methods, performing qualitatively similarly across all configurations considered. Under all three methods, circulation strength, represented in 1D by grid-scale vertical velocity, is decreased when barriers to convection are reduced. This effect is most extreme under specified radiative cooling, and is shown to come from increased static stability in the column's reference radiative-convective equilibrium profile. This argument can be extended to interactive radiation cases as well, though perhaps less conclusively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Climate impacts in scenarios: time to close the loop?

Reaching a full understanding of the consequences of climate change for society and ecosystems, and the ensuing needs for adaptation, requires a consideration of the interactions between human and Earth systems. Currently, however, climate research largely separates the influence of society on climate from the influence of climate on society; that is, it doesn’t “close the loop.” A primary example of this approach is the generation and use of earth system model (ESM) simulations in the climate change research community. Large-scale socio-economic models, known as integrated assessment models (IAMs), are used to project emissions and land use change which serve as input to ESMs. ESM projections then serve as input to models of impacts on society and ecosystems. But, according to this modeling chain, those impacts do not affect the emissions and land use that drove the ESMs in the first place. Previous work has not drawn firm conclusions on whether this feedback would be large enough to warrant explicitly accounting for it. Two prominent possibilities, however, are that emissions and land use scenarios representing the high and low ends of the plausible range of future climate change are both too extreme. The high-end scenario may miss damaging impacts that would reduce economic activity, and therefore emissions, while the low-end scenario may ignore climate feedbacks that would make large-scale land-based carbon removal ineffective and therefore would hamper mitigation at the level assumed by the scenario. In this piece, we identify the opportunities and challenges that implementing such feedback loops would face. We argue that recent developments in climate impact research, human system modeling and ESM emulation make the time ripe to use IAMs in a structured model intercomparison exercise. Model intercomparison projects have benefitted the climate modeling community for decade snow, and more recently have also benefitted the impact modeling community. An IAM intercomparison focused on integrating impacts could make large strides in testing the implications of these feedbacks and assessing whether closing the loop would fundamentally change our outlook on future climate changes and their consequences.

Tebaldi, Claudia↗
DOE OSTI2026

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗
DOE OSTI2025

Data and code for Daily and Multi-Day Extreme Rainfall Analysis Under Future Climates Using Stochastic Storm Transposition and NEX-GDDP-CMIP6 Over CONUS

This data package provides inputs, codes, and outputs for a comprehensive analysis of projected changes in extreme precipitation across 10 regions of the continental United States, using 34 downscaled Earth System Models (ESMs) from the NASA Earth Exchange Global Daily Downscaled Projections, Coupled Model Intercomparison Project Phase 6 (NEX-GDDP-CMIP6) dataset. These models are part of the Coupled Model Intercomparison Project Phase 6 (CMIP6), a coordinated climate modeling framework widely used to assess climate change impacts. The analysis applies a stochastic storm transposition method to quantify changes in extreme rainfall under two Shared Socioeconomic Pathway (SSP) climate scenarios—SSP2-4.5 (moderate emissions) and SSP5-8.5 (high emissions)—compared to historical conditions (1995–2014 vs. 2081–2100). The dataset includes rainfall depth estimates for extreme events with return periods from 2 to 500 years across multiple storm durations (1, 3, and 5 days) for each of the 10 U.S. regions. Weighted ensemble statistics are derived from individual ESM performance against historical precipitation patterns, enabling robust uncertainty quantification through both sign-based and permutation-test-based model agreement assessments. Key analyses address: (1) relative changes in extreme precipitation for each climate scenario, (2) differences between SSP scenarios (SSP5-8.5 vs. SSP2-4.5), (3) contrasts between rare and frequent events, and (4) variations between multi-day and daily storm durations. The workflow produces ensemble statistics—median, 5th, 25th, 75th, and 95th percentiles—along with model agreement metrics that identify regions and event types with robust climate change signals. The dataset includes: processed rainfall depth outputs (netCDF format) from the RainyDay Python package, ESM weights from historical performance evaluation using DayMet observations, ensemble statistics across all storm dimensions, and figures summarizing key findings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Increased Asian Sulfate Aerosol Emissions Remarkably Enhance Sahel Summer Precipitation

Observational evidence shows that Sahel summer precipitation has experienced a considerable increase since the 1980s, coinciding with significant diverging trends of increased sulfate emissions in Asia and decreased emissions in Europe (dipole pattern of aerosols between Asia and Europe). The decrease in European sulfate aerosols has substantial effects on the Sahel summer precipitation increase, but the corresponding effect of increased Asian sulfate is unknown. Multi-model simulations in the Precipitation Driver and Response Model Intercomparison Project (PDRMIP) show, compared to decreased European aerosols, that increased Asian aerosols similarly enhance the Sahel summer precipitation but with different large-scale atmospheric circulation changes. Further analysis of the Sixth Coupled Model Intercomparison Project (CMIP6) simulations under historical attribution and various emission scenarios reinforces the results about the climate impacts of anthropogenic aerosols and suggests that in future scenarios with strong international cooperation and rapid climate mitigations (SSP2-45), the Sahel drought will be intensified likely due to the decline in Asian aerosol emissions. Our results suggest that Asian anthropogenic aerosols are likely a non-negligible driver of the recent recovery in Sahel precipitation amounts

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Atmospheric River Detection Under Changing Seasonality and Mean-State Climate: ARTMIP Tier 2 Paleoclimate Experiments

Atmospheric rivers (ARs) are filamentary structures within the atmosphere that account for a substantial portion of poleward moisture transport and play an important role in Earth's hydroclimate. However, there is no one quantitative definition for what constitutes an atmospheric river, leading to uncertainty in quantifying how these systems respond to global change. This study seeks to better understand how different AR detection tools (ARDTs) respond to changes in climate states utilizing single-forcing climate model experiments under the aegis of the Atmospheric River Tracking Method Intercomparison Project (ARTMIP). We compare a simulation with an early Holocene orbital configuration and another with CO2 levels of the Last Glacial Maximum to a preindustrial control simulation to test how the ARDTs respond to changes in seasonality and mean climate state, respectively. We find good agreement among the algorithms in the AR response to the changing orbital configuration, with a poleward shift in AR frequency that tracks seasonal poleward shifts in atmospheric water vapor and zonal winds. In the low CO2 simulation, the algorithms generally agree on the sign of AR changes, but there is substantial spread in their magnitude, indicating that mean-state changes lead to larger uncertainty. This disagreement likely arises primarily from differences between algorithms in their thresholds for water vapor and its transport used for identifying ARs. These findings warrant caution in ARDT selection for paleoclimate and climate change studies in which there is a change to the mean climate state, as ARDT selection contributes substantial uncertainty in such cases.

Atmospheric river, paleoclimate↗
DOE OSTI2025

Remote Influence of Andean Convection on Amazonian Rainfall and Its Mechanisms

Models from Coupled Model Intercomparison Project Phase 6 produce too much precipitation over the Andes but too little over the Amazon or the Wet Andes-Dry Amazon (WADA) bias pattern. Unlike the conventional view that convection parameterization and land model deficiencies can contribute to Amazonian rainfall biases, we approach this long-standing biased model behavior through the lens of Andean convection. Using Community Earth System Model v1.1 and focusing on the wet season, our mechanism-denial experiments demonstrate that Andean convection notably reduces precipitation over the Amazon during austral summer. The Andean forced Amazonian response operates on weather timescale. Furthermore, the reduction of Amazonian rainfall is detectable within a few hours after initial Andean forcing. The precipitation response is primarily driven by variations in the moisture budget and is moderated by changes in convective available potential energy over the Amazon. Changes in the total advection of moisture over the Amazon are dominated by the vertical advection term and can be attributed to discrepancies in the dynamic omega field. In the experiments, the Andean east flank region is scrutinized where the vertical velocity and moisture fields play an intermediary role for the Andean driven WADA connection. The Andean forcing induces descending anomalies on the Andean east flank. The disturbances of wind and geopotential fields over the Andean east flank propagate eastward via Kelvin waves. Over the Amazon, descending anomalies and advective drying lead to reduction of mid-to-high level cloud, increase of shortwave cloud forcing and surface net radiation, and enhancement of themodynamic stability and rainfall reduction.

58 GEOSCIENCES↗
DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗