Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Comparing multi-model ensemble simulations with observations and decadal projections of upper atmospheric variations following the Hunga eruption

The Hunga Tonga–Hunga Ha'apai Model–Observation Comparison (HTHH–MOC) project aims to comprehensively investigate the evolution of volcanic water vapor and sulfur emissions and their subsequent atmospheric impacts and underlying response mechanisms using state-of-the-art global climate models. This study evaluates multi-model ensemble simulations participating in the HTHH–MOC free-run experiment with climate projections for 10 years (2022–2032). Model results are evaluated against satellite observations to assess their ability to reproduce the observed evolution of stratospheric water vapor, aerosols, temperature, and ozone from 2022 to 2024. The participating models accurately capture the observed distribution patterns and associated upper atmospheric responses, providing confidence for their future projections. Model simulations suggest that the Hunga eruption-induced stratospheric water vapor anomaly lasts 4–7 years, with a water vapor e-folding time of 31–43 months. This prolonged water vapor perturbation leads to significant stratospheric and mesospheric cooling, resulting in significant ozone loss in the upper stratosphere and lower mesosphere for 7–10 years. Comparisons between simulations with both SO 2 and H 2 O emissions and those with H 2 O-only emissions indicate that the pronounced dipole response with upper-stratospheric cooling and lower-stratospheric warming is driven by the combined effects of SO 2 and H 2 O injections. These results highlight the prolonged atmospheric impacts of the Hunga eruption and the potential critical role of stratospheric water vapor in modulating long-term atmospheric chemistry and dynamics.

Zhuo, Zhihong [Univ. of Quebec, Montreal, QC (Cana↗
DOE OSTI2025

Harnessing land-atmosphere interactions to enhance subseasonal-to-seasonal predictability

2025 Advancing Understanding of Land-Atmosphere Interactions and Processes on S2S Predictability Workshop What: 227 registered workshop participants gathered in person (43%) and online (57%) to discuss state-of-the-art scientific understanding and modeling of land-atmosphere interactions and related processes in the context of subseasonal-to-seasonal (S2S) predictability. Topics covered sources of S2S predictability, land model initialization methods, model diagnosis and evaluation metrics, AI/ML analysis and applications, and coordination of future community multi-model S2S forecast focused experiments. To advance the science, this community workshop, organized by NSF NCAR, NOAA, NASA, and DOE, aimed to 1) identify process- and application-oriented metrics for assessing S2S prediction skill and 2) develop experimental protocols for coordinated experiments to isolate, quantify, and understand the role of land-atmosphere interactions in S2S predictability. When: June 16-18, 2025 Where: Boulder, CO, USA, and online.

Land-Atmosphere Interaction↗
DOE OSTI2025

Projected evolution of droughts and human exposure in the contiguous United States under SSP5-8.5: a regional downscaling perspective

The increasingly unpredictable and extreme weather patterns under a warming climate underscore the urgency of accurate regional assessments of future drought risk. This study evaluates the projected drought evolution in the contiguous United States under the high-emission shared socioeconomic pathway 5–8.5 climate scenario for the coming decades. Using a multi-model ensemble of six Coupled Model Intercomparison Project Phase 6 global climate models combined with dynamical downscaling techniques, we analyzed near-term (2020–2039) and mid-term (2040–2059) drought patterns using the self-calibrating palmer drought severity index (ScPDSI), the standardized precipitation index (SPI-12), and the Standardized Precipitation-Evapotranspiration Index (SPEI-12). Results reveal a widespread increase in abnormally dry (D0) and moderate drought (D1) conditions, particularly in urban areas, while severe (D2), extreme (D3), and exceptional (D4) droughts are expected to become less common in many regions. Meanwhile, persistent and intensifying droughts are projected in the western and southwestern U.S., driven by long-term soil moisture deficits. The ScPDSI projects that 1.1 million urban residents will be affected by D0 conditions in 2050, while SPI-12 suggests a decrease in the total affected populations after 2040. ScPDSI indicates prolonged droughts in the West, and SPI-12 captures transient variability. Although the total drought-exposed population is expected to decrease, urban areas will continue to bear a greater burden, particularly for mild droughts (D0, D1). These findings highlight a shift toward more frequent mild droughts, fewer severe droughts, and persistent drying in the Southwest, emphasizing the need for region-specific adaptation strategies.

CMIP6↗
DOE OSTI2025

A multi-model assessment of global freshwater temperature and thermoelectric power supply under climate change

Water temperature is a key abiotic factor influencing aquatic ecosystem health and the services provided to both nature and humans. Global water temperature models offer possibilities to improve our understanding of water temperature regimes, which is increasingly important against the backdrop of climate change. Yet, existing studies have predominantly relied on a single model, which can lead to an incomplete representation of uncertainty and potential biases, in addition to limited insight into the range of possible future conditions, which ultimately reduces the robustness of climate impact assessments. Here, we provide a comprehensive assessment of surface freshwater temperature changes from various river and lake models for both past conditions and under future scenarios of climate change. Global models consistently simulate that surface water temperatures are currently 0.5 °C–0.8 °C higher than at the turn of the century (i.e. 1981–2000), and that warming will extend and intensify with future global change throughout the 21st century. While the strength of warming is highly sensitive to the different water temperature models, emissions scenarios and global climate models, our multi-model ensemble shows a global average annual water temperature rise of between +1.3 °C and +4.1 °C by the end of the century. To illustrate a potential societal impact of our results, we evaluate how future changes in discharge and water temperature may affect existing thermoelectric power plants, estimating average annual reductions of 1.5%–6% in global usable capacity by the end of the century. However, with river water temperatures projected to exhibit more pronounced seasonal patterns in the future—especially under the more extreme climate change scenarios and during summer months in the Northern Hemisphere—intra-annual reductions in usable capacity can be much more severe. Given the challenges associated with (large-scale) adaptation to control water temperature regimes, strong climate change mitigation is crucial for minimising water temperature rises and its associated negative impacts on humankind and ecosystems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

An Alternative Ensemble Streamflow Prediction Approach Using Improved Subseasonal Precipitation Forecasts from the North America Multi-Model Ensemble Phase II

In this article, streamflow forecasting at a subseasonal time scale (10–30 days into the future) is important for various human activities. The ensemble streamflow prediction (ESP) is a widely applied technique for subseasonal streamflow forecasting. However, ESP’s reliance on the randomly resampled historical precipitation limits its predictive capability. Available dynamical subseasonal precipitation forecasts provide an alternative to the randomly resampled precipitation in ESP. Prior studies found the predictive performance of raw subseasonal precipitation forecast is limited in many regions such as the central south of the United States, which raises questions about its effectiveness in assisting streamflow forecasting. To further assess the hydrologic applicability of dynamical subseasonal precipitation forecasts, we test the subseasonal precipitation forecast from North America Multi-Model Ensemble Phase II (NMME-2) at four watersheds in the central south region of the United States. The subseasonal precipitation forecasts are postprocessed with bias correction and spatial disaggregation (BCSD) to correct bias and improve spatial resolution before replacing the randomly resampled precipitation in ESP for streamflow predictions. The performance of the resulting streamflow predictions is benchmarked with ESP. Evaluation is conducted using Kling–Gupta Efficiency (KGE), continuous ranked probability score (CRPS), probability of detection (POD), false alarm ratios (FARs), as well as reliability diagrams. Our results suggest that BCSD-corrected subseasonal precipitation forecasts lead to overall improved streamflow predictions due to added skills in winter and spring. Our results also suggest that BCSD-corrected subseasonal precipitation forecasts lead to improved predictions on the occurrence of high-percentile streamflow values above 75%. Overall, BCSD-corrected subseasonal precipitation has shown promising performance, highlighting its potential broader applications for river and flood forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Multi-scale impacts of climate change on hydropower for long-term water-energy planning in the contiguous United States

Climate change impacts on watersheds can potentially exacerbate water scarcity issues where water serves multiple purposes including hydropower. The long-term management of water and energy resources is still mostly approached in a siloed manner at different basins or watersheds, failing to consider the potential impacts that may concurrently affect many regions at once. There is a need for a large-scale hydropower modeling framework that can examine climate impacts across adjoining river basins and balancing authorities (BAs) and provide a periodic assessment at regional to national scales. Expanding from our prior assessment only for the United States (US) federal hydropower plants, we enhance and extend two regional hydropower models to cover over 85% of the total hydropower nameplate capacity and present the first contiguous US-wide assessment of future hydropower production under Coupled Model Intercomparison Project phase 6’s high-end Shared Socioeconomic Pathway 5-8.5 emission scenario using an uncertainty-aware multi-model ensemble approach. We present regional hydropower projections, using both BA regions and US Hydrologic Subregions (HUC4s), to consistently inform the energy and water communities for two future periods—the near-term (2020–2039) and the mid-term (2040–2059) relative to a historical baseline period (1980–2019). We find that the median projected changes in annual hydropower generation are typically positive—approximately 5% in the near-term, and 10% in the mid-term. However, since the risk of regional droughts is also projected to increase, future planning cannot overly rely on the ensemble median, as the potential of severe hydropower reductions could be overlooked. The assessment offers an ensemble of future hydropower generation projections, providing regional utilities and power system operators with consistent data to develop drought scenarios, design long duration storage and evaluate energy infrastructure reliability under intensified inter-annual and seasonal variability.

13 HYDRO ENERGY↗
DOE OSTI2026

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗
DOE OSTI2025

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗
DOE OSTI2024

Health and air pollutant emission impacts of net zero CO2 by 2050 scenarios from the energy modeling forum 37 study

Carbon dioxide and non-greenhouse gas air pollutants are emitted from many of the same sources. Decarbonization actions thus typically yield air pollutant emission reductions, resulting in significant air quality benefits. Although several studies have highlighted this connection, including in the context of net zero carbon emission targets, substantial uncertainty remains regarding how alternative technological pathways to this goal will affect the spatial distribution and magnitude of air pollutants. Comprehensive multi-model and multi-scenario analyzes are needed to explore the relative impacts of alternative pathways. Here, our study begins to address this gap by leveraging the results from the recent Energy Modeling Forum 37 inter-model comparison exercise on U.S. decarbonization pathways. Comparing the results of the six teams who submitted air pollutant emissions suggests that strategies that target net zero U.S. carbon emissions would yield significant reductions in many air pollutants, and that this finding is generally robust across pathways. However, some energy sources, such as biomass and fossil fuels with carbon capture, will emit air pollutants and can potentially influence the magnitude, spatial distribution, and even sign of localized air pollutant emission changes. In the second part of this analysis, a simplified air quality and health impacts screening model is used to evaluate the air quality impacts in 2035 of sectoral emission changes from the three models that provided sectoral detail. Relative to a reference scenario, a net zero pathway is estimated to reduce fine particulate matter concentrations across the contiguous U.S., with health benefits from reduced mortality ranging from $\$$65 billion to $\$$250 billion in 2035 alone (2023$\$$s). These benefits would be expected to grow over time as the net zero trajectory becomes more stringent. Both the magnitude of potential benefits and the substantial variation of the projections across models underscore the need for an EMF-like inter-model comparison exercise focused on air quality.

Air pollutants↗
DOE OSTI2026

Performance evaluation of CMIP6 models on the Arctic-Siberian Plain teleconnection affecting the East Asian heat waves

The frequency and intensity of summer heat waves in East Asia have increased sharply in recent decades, significantly impacting public health and the economy. The Arctic-Siberian Plain (ASP) teleconnection pattern has been identified as a key driver, with ASP warming amplifying atmospheric circulation patterns conducive to extreme temperatures. This study evaluates the ability of Coupled Model Inter-comparison Project phase 6 models to simulate the ASP pattern across interannual variability (IAV) and intra-seasonal variability (ISV) timescales using the Common Basis Function method. The multi-model mean shows statistically significant pattern correlations with ERA5 reanalysis, with correlation coefficients of 0.90 and 0.99 for IAV and ISV, respectively. While the ASP pattern is generally well captured, models exhibit substantial inter-model diversity in the intensity and position of anticyclonic anomalies over the ASP and East Asia. Models with ASP pattern variability similar to reanalysis better reproduce extreme East Asian temperatures, whereas those over- or underestimating ASP variability exhibit lower skill. These performance differences are related to differences in simulating key variables associated with the development of the ASP pattern. Our findings highlight the role of the ASP pattern in modulating extreme heat events, as models with improved ASP simulations align more closely with observed temperature extremes. Refining ASP representations in models could enhance seasonal heat wave predictions, improving climate adaptation strategies.

Arctic-Siberian Plain (ASP)↗
DOE OSTI2026

Diagnosing the representation of surface and layered soil moisture in Earth system models

Surface soil moisture (mrsos) and vertically integrated soil moisture (mrsol) over the top 10 cm should, by definition, be physically consistent in Earth System Models (ESMs). However, an evaluation of nine CMIP6 models reveals substantial inconsistencies: in some models, mrsos and integrated mrsol agree globally; in others, they align only in specific regions; and in a few, they diverge across all grid cells. These discrepancies arise from a combination of factors, including metadata errors, inconsistent variable definitions, or diagnostic sequencing within the model. We demonstrate how such issues can lead to significant biases, even when both variables are present and seemingly well-defined. As model complexity increases and multi-model comparisons become more common, assumptions about variable equivalence may lead to flawed conclusions. This study highlights the need for routine consistency checks, improved metadata standards, and community-wide practices that ensure reliability of derived variables across ESM outputs, particularly in preparation for CMIP7.

Earth system models↗
DOE OSTI2025

Evaluation of historical precipitation interannual variability in CMIP6 over the United States

Interannual precipitation variability profoundly influences society via its effects on agriculture, water resources, infrastructure, and disaster risks. In this study, we use daily in situ precipitation observations from the global historical climatology network-daily (GHCN-D) to assess the ability of 21 Coupled Model Intercomparison Project Phase 6 (CMIP6) models, including the 50-member fifth-generation Canadian Earth System Model single model initial-condition large ensemble (CanESM5_SMILE), to realistically simulate historical interannual precipitation variability trends within 17 regions of the contiguous United States (CONUS). We assess how accurately the CMIP6 simulations align with observational data across annual, summer, and winter periods, focusing on four key hydrometeorological metrics, including interannual precipitation variability, relative interannual precipitation variability (coefficient of variation), annual mean precipitation, and annual wet day frequency. Our findings reveal that CMIP6 ensemble members generally reproduce the spatial patterns of observed trends in annual mean precipitation. In most regions, models agree well with the signs of observed changes in annual mean precipitation, though discrepancies in trend magnitude are evident. Further, observed trends in winter mean precipitation broadly exhibit a spatial pattern similar to that of the observed annual mean. However, analysis of the CanESM5_SMILE shows that trends in precipitation variability may primarily be the result of model-simulated internal variability, suggesting caution in interpreting multi-model single-realization ensemble results. Challenges in accurately simulating interannual precipitation variability underscore the need for ongoing model refinement and validation to enhance climate projections, especially in regions vulnerable to extreme precipitation events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Cooperative Agreement To Analyze variabiLity, change and predictabilitY in the earth SysTem (CATALYST)

CATALYST proposes to perform foundational coordinated research in a team-oriented collaborative effort aimed at advancing a robust understanding of modes of Earth system variability and change using models, observations and process studies. The proposed research will address the DOE/BER mission by exploring the limits to predictability, identifying fundamental underlying mechanisms, quantifying interactions among modes of variability, and discovering tipping points in the Earth system to understand the current and future impacts of these phenomena on regional and global climate. Four fundamental gaps are identified in our knowledge of the Earth system: 1) What are the limits to predictability on various timescales? 2) What are the interactions among modes of Earth system variability? 3) How may modes of Earth system variability change in response to changes in external forcing, and what are the tipping points involved with those changes? 4) How are high impact events connected to modes of Earth system variability and how may they change in the future? Related to those gaps in our knowledge, we formulate four research objectives to address those gaps using a combination of Earth system models (ESMs) and machine learning (ML) methods. Research Objective 1 (RO1) addresses the first gap above and proposes to understand modes of variability and their limits of predictability on subseasonal to decadal timescales using ESMs and ML. Research Objective 2 (RO2) addresses the second gap and proposes to use a hierarchy of models to understand relevant processes and feedbacks related to how modes of variability interact with each other. Research Objective 3 (RO3) is designed to study the third gap and proposes to examine the role of external forcings in changes of modes of Earth system variability and their interactions, and the likelihood and predictability of tipping points and irreversible changes. Research Objective 4 (RO4) will address the fourth gap and proposes to use high resolution ESMs, regionally refined models (RRMs), and ML methods to investigate the relationships between high impact events (e.g. flash droughts and precipitation extremes, atmospheric rivers (ARs), tropical cyclones (TCs), storm surge/sea level rise), the synoptic systems that produce them, and their changes related to modes of Earth system variability. The research will involve the use of the Community Earth System Model (CESM), Energy Exascale Earth System Model (E3SM), CMIP multi-model data sets, a hierarchy of simpler models, and numerous observational data sets. In the course of the proposed research, CATALYST will contribute to metrics and diagnostics that will be integrated in Coordinated Model Evaluation Capabilities (CMEC), particularly with regards to the Quasi-biennial Oscillation (QBO) and its interactions with the Madden-Julian Oscillation (MJO), high atmospheric pressure blocking, and new precipitation metrics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

CMIP6-based Multi-model Hydropower Projection over the Conterminous US, Version 1.1

This dataset presents a suite of hydropower projections for the conterminous United States (CONUS), derived from multiple downscaled and bias-corrected Global Climate Models (GCMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). The CMIP6 GCMs are downscaled using either statistical (DBCCA) or dynamical (RegCM) approaches, based on two meteorological reference datasets (Daymet and Livneh). The resulting downscaled precipitation, temperature, and wind speed data are then used to drive two calibrated hydrologic models (VIC and PRMS), enabling simulations of projected future hydrologic responses across the CONUS. Simulated total runoff is subsequently employed to drive two hydropower models (WMP, now implemented as mosartwmpy-power, and WRES) to evaluate how climate change may affect future hydropower production for both federal and non-federal hydropower fleets. This dataset was developed to support the SECURE Water Act Section 9505 Assessment for the U.S. Department of Energy (DOE) Water Power Technologies Office (WPTO). For further details, see Broman et al. (2024), Thurber et al. (2024), Kao et al. (2022), and Zhou et al. (2023).

Voisin, Nathalie [Pacific Northwest National Labor↗
DOE OSTI2024

Evaluation of Global Fire Simulations in CMIP6 Earth System Models

Fire is the primary form of terrestrial ecosystem disturbance on a global scale and an important Earth system process. Most Earth system models (ESMs) have incorporated fire modeling, with 19 of them submitting model outputs of fire-related variables to the Coupled Model Intercomparison Project Phase 6 (CMIP6). This study provides the first comprehensive evaluation of CMIP6 historical fire simulations by comparing them with multiple satellite-based products and charcoal-based historical reconstructions. Our results show that most CMIP6 models simulate the present-day global burned area and fire carbon emissions within the range of satellite-based products. They also capture the major features of observed spatial patterns and seasonal cycles, the relationship of fires with precipitation and population density, and the influence of the El Niño–Southern Oscillation (ENSO) on the interannual variability of tropical fires. Regional fire carbon emissions simulated by the CMIP6 models from 1850 to 2010 generally align with the charcoal-based reconstructions, although there are regional mismatches, such as in southern South America and eastern temperate North America prior to the 1910s and in temperate North America, eastern boreal North America, Europe, and boreal Asia since the 1980s. The CMIP6 simulations have addressed three critical issues identified in CMIP5: (1) the simulated global burned area being less than half of that of the observations, (2) the failure to reproduce the high burned area fraction observed in Africa, and (3) the weak fire seasonal variability. Furthermore, the CMIP6 models exhibit improved accuracy in capturing the observed relationship between fires and both climatic and socioeconomic drivers and better align with the historical long-term trends indicated by charcoal-based reconstructions in most regions worldwide. However, the CMIP6 models still fail to reproduce the decline in global burned area and fire carbon emissions observed over the past 2 decades, mainly attributed to an underestimation of anthropogenic fire suppression, and the spring peak in fires in the Northern Hemisphere midlatitudes, mainly due to an underestimation of crop fires. In addition, the model underestimates the fire sensitivity to wet–dry conditions, indicating the need to improve fuel wet-ness estimation. Based on these findings, we present specific guidance for fire scheme development and suggest a postprocessing methodology for using CMIP6 multi-model outputs to generate reliable fire projection products.

Wildfire, Earth system models↗
DOE OSTI2025

Standardising the “Gregory method” for calculating equilibrium climate sensitivity

The equilibrium climate sensitivity (ECS) – the equilibrium global mean temperature response to a doubling of atmospheric CO 2 – is a high-profile metric for quantifying the Earth system's response to human-induced climate change. A widely applied approach to estimating the ECS is the “Gregory method” (Gregory et al., 2004), which uses an ordinary least squares (OLS) regression between the net radiative flux, N, and surface air temperature anomalies, ΔT, from a 150 year experiment in which atmospheric CO 2 concentrations are quadrupled. The ECS is determined by extrapolating the linear fit to N=0, i.e. the ΔT-intercept, indicating the point at which the system is back in equilibrium. This method has been used to compare ECS estimates across the CMIP5 and CMIP6 ensembles and will likely be a key diagnostic for CMIP7. Despite its widespread application, there is little consistency or transparency between studies in how the climate model data is processed prior to the regression, leading to potential discrepancies in ECS estimates. We identify 32 alternative data processing pathways, varying by differences in global mean weighting, net radiative flux variable, anomaly calculation method, and linear regression fit. Using 44 CMIP6 models, we systematically assess the impact of these choices on ECS estimates and calculate uncertainty ranges using two bootstrap approaches. While the inter-model ECS range is insensitive to the data processing pathway, individual outlier models exhibit notable differences. Approximating a model's native grid cell area (if irregular) with cosine of the latitude can decrease the ECS by 11 %, the choice of N-variable can change the ECS by 6 %, and some anomaly calculation methods can introduce spurious temporal correlations in the processed data. Beyond data processing choices, we also evaluate an alternative linear regression method – total least squares (TLS) – which has a more statistically robust basis than OLS. However, for consistency with previous literature, and given TLS may reduce the ECS compared to OLS (by up to 24 %), thereby making a known bias in the Gregory method worse, we do not feel there is sufficient clarity to recommend a transition to TLS in all cases. To improve reproducibility and comparability in future studies, we recommend a standardised Gregory method: weighting the global mean by cell area, using the top of the atmosphere (as opposed to the top of model) N-variable, and calculating anomalies by first applying a rolling average to the preindustrial control timeseries then subtracting from the raw CO 2 quadrupling experiment. This approach accounts for model drift while reducing noise in the data to best meet the pre-conditions of the linear regression. While CMIP6 results of the multi-model mean ECS appear insensitive to these processing choices, similar assumptions may not hold for CMIP7, underscoring the need for standardised data preparation in future climate sensitivity assessments.

Geosciences↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗