Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A process-based evaluation of biases in extratropical stratosphere–troposphere coupling in subseasonal forecast systems

Abstract. Two-way coupling between the stratosphere and troposphere is recognized as an important source of subseasonal-to-seasonal (S2S) predictability and can open windows of opportunity for improved forecasts. Model biases can, however, lead to a poor representation of such coupling processes; drifts in a model's circulation related to model biases, resolution, and parameterizations have the potential to feed back on the circulation and affect stratosphere–troposphere coupling. We introduce a set of diagnostics using readily available data that can be used to reveal these biases and then apply these diagnostics to 22 S2S forecast systems. In the Northern Hemisphere, nearly all S2S forecast systems underestimate the strength of the observed upward coupling from the troposphere to the stratosphere, downward coupling within the stratosphere, and the persistence of lower-stratospheric temperature anomalies. While downward coupling from the lower stratosphere to the near surface is well represented in the multi-model ensemble mean, there is substantial intermodel spread likely related to how well each model represents tropospheric stationary waves. In the Southern Hemisphere, the stratospheric vortex is oversensitive to upward-propagating wave flux in the forecast systems. Forecast systems generally overestimate the strength of downward coupling from the lower stratosphere to the troposphere, even as most underestimate the radiative persistence in the lower stratosphere. In both hemispheres, models with higher lids and a better representation of tropospheric quasi-stationary waves generally perform better at simulating these coupling processes.

Garfinkel, Chaim I. (ORCID:000000017258666X)↗
DOE OSTI2021

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluating Sea Breezes and Associated Convective Cloud Evolution in the Model Gray Zone

We characterize convective clouds associated with sea‐breeze circulations (SBC) using multi‐agency observations and multi‐case ensemble model simulations. The focus is on assessing convective cloud lifecycle properties and their merging behavior, as well as the environmental conditions they are embedded in, particularly SBC features. In total, 46 SBC days over the Houston‐Galveston region are selected and simulated using the Weather Research and Forecasting (WRF) model at a gray zone scale with a forecast‐like parameterization setup. Advanced techniques, including change‐point detection, a Lagrangian cloud tracking method, and a newly developed cell merging and splitting detection algorithm, are applied and/or developed for this study. Our findings indicate that the WRF model at 1 km grid spacing well represents the thermodynamic conditions over the region, as well as SBC timing and intensity. However, for the associated convective cells, WRF overestimates the 30‐dBZ echo top height, cell area, and maximum radar reflectivity compared to radar observations. This overestimation is potentially due to under‐resolved entrainment processes, an overestimated merging frequency, and the overestimation of updraft intensity. Furthermore, the model exhibits a deficiency in simulating congestus clouds, showing a more rapid transition from shallow to deep convection compared to observed behavior. Moreover, observations indicate stronger, deeper, and wider clouds when merging happens. Conversely, in simulations, the merging process does not necessarily lead to higher or longer‐lived cells, as many cases experience rapid and frequent merging and splitting which may result in more variance in convective updraft velocity during the convection lifetime.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Addressing bias in bagging and boosting regression models

As artificial intelligence (AI) becomes widespread, there is increasing attention on investigating bias in machine learning (ML) models. Previous research concentrated on classification problems, with little emphasis on regression models. This paper presents an easy-to-apply and effective methodology for mitigating bias in bagging and boosting regression models, that is also applicable to any model trained through minimizing a differentiable loss function. Our methodology measures bias rigorously and extends the ML model's loss function with a regularization term to penalize high correlations between model errors and protected attributes. We applied our approach to three popular tree-based ensemble models: a random forest model (RF), a gradient-boosted model (GBT), and an extreme gradient boosting model (XGBoost). We implemented our methodology on a case study for predicting road-level traffic volume, where RF, GBT, and XGBoost models were shown to have high accuracy. Despite high accuracy, the ML models were shown to perform poorly on roads in minority-populated areas. Our bias mitigation approach reduced minority-related bias by over 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Is there warming in the pipeline? A multi-model analysis of the Zero Emissions Commitment from CO 2

Abstract. The Zero Emissions Commitment (ZEC) is the change in global mean temperature expected to occur following the cessation of net CO 2 emissions and as such is a critical parameter for calculating the remaining carbon budget. The Zero Emissions Commitment Model Intercomparison Project (ZECMIP) was established to gain a better understanding of the potential magnitude and sign of ZEC, in addition to the processes that underlie this metric. A total of 18 Earth system models of both full and intermediate complexity participated in ZECMIP. All models conducted an experiment where atmospheric CO 2 concentration increases exponentially until 1000 PgC has been emitted. Thereafter emissions are set to zero and models are configured to allow free evolution of atmospheric CO 2 concentration. Many models conducted additional second-priority simulations with different cumulative emission totals and an alternative idealized emissions pathway with a gradual transition to zero emissions. The inter-model range of ZEC 50 years after emissions cease for the 1000 PgC experiment is -0.36 to 0.29°C, with a model ensemble mean of -0.07 °C, median of -0.05°C, and standard deviation of 0.19°C. Models exhibit a wide variety of behaviours after emissions cease, with some models continuing to warm for decades to millennia and others cooling substantially. Analysis shows that both the carbon uptake by the ocean and the terrestrial biosphere are important for counteracting the warming effect from the reduction in ocean heat uptake in the decades after emissions cease. This warming effect is difficult to constrain due to high uncertainty in the efficacy of ocean heat uptake. Overall, the most likely value of ZEC on multi-decadal timescales is close to zero, consistent with previous model experiments and simple theory.

MacDougall, Andrew H.↗
DOE OSTI2025

Downscaled CMIP5 projections of physical fire risk understate historical trends

Reliable projections of wildfire risk are important for multi-sector impacts analysis. Statistically downscaled and bias-corrected Earth system model ensemble products are routinely used to analyze regional physical wildfire risk, but evaluations of historical observed trends and variability are lacking. Here, we evaluate physical fire risk over the western United States using the Canadian Forest Fire Weather Index (FWI) by comparing model outputs from the Coupled Model Intercomparison Project Phase 5 (CMIP5), statistically downscaled via the Multivariate Adaptive Constructed Analogs (MACA) approach, against the observational target dataset gridMET, a gridded high-resolution surface meteorological product. We analyze multidecadal trends and interannual variability in seasonal average FWI for the historical period and future projections under two emissions scenarios, and we compare MACA-CMIP5 ensemble results with a simple time series model that generates historical and future projections of seasonal FWI based on bootstrapping observed historical trends and variability. Our findings indicate that MACA-CMIP5 accurately captures the magnitude and spatial patterns of seasonally averaged FWI but tends to underestimate historical decadal trends. We show that future increases in fire risk may be underestimated relative to the simple time series model that projects historical variability into the future. We also highlight that model biases in relative humidity contribute significantly to model-data differences. Our results underscore the importance of historical hindcasting exercises for informing broader multi-sector applications.

FWI↗
DOE OSTI2021

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Regional climate change: consensus, discrepancies, and ways forward

Climate change has emerged across many regions. Some observed regional climate changes, such as amplified Arctic warming and land-sea warming contrasts have been predicted by climate models. However, many other observed regional changes, such as changes in tropical sea surface temperature and monsoon rainfall are not well simulated by climate model ensembles even when taking into account natural internal variability and structural uncertainties in the response of models to anthropogenic radiative forcing. This suggests climate model predictions may not fully reflect what our future will look like. The discrepancies between models and observations are not well understood due to several real and apparent puzzles and limitations such as the “signal-to-noise paradox” and real-world record-shattering extremes falling outside of the possible range predicted by models. Addressing these discrepancies, puzzles and limitations is essential, because understanding and reliably predicting regional climate change is necessary in order to communicate effectively about the underlying drivers of change, provide reliable information to stakeholders, enable societies to adapt, and increase resilience and reduce vulnerability. The challenges of achieving this are greater in the Global South, especially because of the lack of observational data over long time periods and a lack of scientific focus on Global South climate change. To address discrepancies between observations and models, it is important to prioritize resources for understanding regional climate predictions and analyzing where and why models and observations disagree via testing hypotheses of drivers of biases using observations and models. Gaps in understanding can be discovered and filled by exploiting new tools, such as artificial intelligence/machine learning, high-resolution models, new modeling experiments in the model hierarchy, better quantification of forcing, and new observations. Conscious efforts are needed toward creating opportunities that allow regional experts, particularly those from the Global South, to take the lead in regional climate research. This includes co-learning in technical aspects of analyzing simulations and in the physics and dynamics of regional climate change. Finally, improved methods of regional climate communication are needed, which account for the underlying uncertainties, in order to provide reliable and actionable information to stakeholders and the media.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Concurrent Inter-Model Spread of Boreal Winter Westerly Jet Meridional Positions Between the Northern and Southern Hemispheres in CMIP6 Models

Here, this study investigates the inter-model spread of climatological extratropical westerly jets in boreal winter, using the historical simulation of 52 Coupled Model Intercomparison Project phase 6 (CMIP6) models from 1851 to 2014. The results show that there is a substantial spread in the latitude of the upper-tropospheric westerly jet across models, characterised by large inter-model standard deviations to both the poleward and equatorward sides of the jet axis, although the multi-model ensemble mean (MME) performs well in simulating meridional position of westerly jets. Furthermore, we detect the consistency of inter-model jet position spread between the Northern and Southern Hemispheres, based on the inter-model empirical orthogonal function (EOF) decomposition and correlation of regional-averaged zonal winds. Specifically, the models that simulate the westerly jets poleward/equatorward relative to the MME position in one hemisphere also tend to simulate the jets poleward/equatorward in the other hemisphere. Accordingly, we define a global jet spread index to depict the concurrence of jet shift in the two hemispheres. The results of inter-model regression analyses based on this index indicate that the models positioning the jets poleward than the MME tend to simulate a wider Hadley Cell, a poleward-shifted Ferrel Cell in the Southern Hemisphere, enhanced precipitation in the subtropics and suppressed precipitation in the tropics, and warmer sea surface temperatures in the subtropics and mid-latitudes. The present results suggest that improving the simulation of jet positions in climate models requires a comprehensive consideration of thermal states in the tropics and subtropics/mid latitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Statistical Generation of Ocean Forcing With Spatiotemporal Variability for Ice Sheet Models

Melting of ice at the base of floating ice shelves that fringe the Antarctic ice sheet has been identified as a significant source of uncertainty in sea level rise projections. Part of this uncertainty derives from chaotic internal variability of the coupled ocean-atmosphere system. For numerical ice sheet model projections, this uncertainty has not previously been quantified because of the prohibitive computational expense of running large climate model ensembles. Here, we develop and demonstrate a technique that generates independent realizations of internal climate variability from a single climate model simulation. Building on previous developments in model emulation, this technique uses empirical orthogonal function decomposition and Fourier-phase randomization to generate statistically consistent realizations of spatiotemporal variability fields for the target climate variable. The method facilitates efficient sampling of a wide range of climate trajectories, which can also be incorporated within ice sheet or other physical models to represent feedback processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Amplified drought trends in Nepal increase the potential for Himalayan wildfires

Here we report in the spring 2021, Nepal underwent a record wildfire season in which active fires were detected at a rate 10 times greater than the 2002–2020 average. Prior to these major wildfire events, the country experienced a prolonged precipitation deficit and extreme drought during the post-monsoon period (starting in October 2020). An analysis using observational, reanalysis, and climate model ensemble data indicates that both climate variability and climate change-induced severe drought conditions were at play. Further analysis of climate model outputs suggests the likely reoccurrence of drought conditions, thus favoring active wildfire seasons in Nepal throughout the twenty-first century. While the inter-model uncertainty is large and direct modeling of wildfire spread and suppression has not been completed, the demonstrated relationship between a drought index (the standardized precipitation and evapotranspiration index) and subsequent fire activity may offer actionable opportunities for forest managers to employ the monitoring and projection of climate anomalies at sub-seasonal to decadal timescales to inform their management strategies for Nepal’s wildlands.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Future sea level change under CMIP5 and CMIP6 scenarios from the Greenland and Antarctic ice sheets

Projections of the sea level contribution from the Greenland and Antarctic ice sheets rely on atmospheric and oceanic drivers obtained from climate models. The Earth System Models participating in the Coupled Model Intercomparison Project phase 6 (CMIP6) generally project greater future warming compared with the previous CMIP5 effort. Here we use four CMIP6 models and a selection of CMIP5 models to force multiple ice sheet models as part of the Ice Sheet Model Intercomparison Project for CMIP6 (ISMIP6). We find that the projected sea level contribution at 2100 from the ice sheet model ensemble under the CMIP6 scenarios falls within the CMIP5 range for the Antarctic ice sheet but is significantly increased for Greenland. Warmer atmosphere in CMIP6 models results in higher Greenland mass loss due to surface melt. For Antarctica, CMIP6 forcing is similar to CMIP5 and mass gain from increased snowfall counteracts increased loss due to ocean warming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Machine Learning for Mapping Multipactor Susceptibility in RF Systems: Capabilities and Generalization Constraints

Multipactor is a surface-driven electron avalanche phenomenon that degrades the performance and reliability of radio-frequency (RF) systems in particle accelerator and vacuum electronics applications. Multipactor behavior in a given device structure is conventionally assessed through susceptibility charts, which provide a parameter-space characterization of the instability. In this work, we assess the capabilities of machine-learning (ML) models to learn and predict such susceptibility charts and analyze the constraints governing their generalization across materials. Using a simulation-derived dataset spanning six distinct secondary-electron-yield material profiles in a canonical two-surface planar geometry, we train supervised regression models and artificial neural networks to predict the time-averaged electron growth rate, δavg, across the relevant parameter space. Model performance is evaluated using metrics that explicitly probe the structure of susceptibility charts, including Intersection over Union, Structural Similarity Index, and correlation analysis. Tree-based ensemble models outperform neural-network models in reconstructing susceptibility regions and in generalizing across material domains. Principal-component analysis reveals disjoint material feature distributions, indicating that the piecewise mode structure of multipactor susceptibility is difficult to represent with a single global model and that generalization is constrained by data coverage rather than by model complexity. An exhaustive reduced-coverage study further shows that sparse material-space coverage can yield mean performance in the same general range but producing large variability in the susceptibility-region overlap. These results clarify the capabilities of ML-based surrogate models for parameter-space characterization of multipactor discharge. They also provide guidance for their appropriate use in RF system design.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Quantitative Analysis and Prediction of Thermal Runaway Metrics of High-Nickel Oxide Cathodes by Machine Learning Models

The pursuit of higher energy density in lithium-ion batteries has made high-nickel (Ni) layered oxides leading cathode candidates for next-generation electric vehicles. However, their poor thermal stability, particularly at Ni contents ≥ 90%, increases the risk of cathode-initiated thermal runaway. Furthermore, we present a data-driven framework combining linear and nonlinear machine learning models to predict key thermal runaway descriptors from a high-throughput differential scanning calorimetry database. With cathode composition and state of charge (SOC) as input features, the ensemble model accurately predicts peak temperature, heat release, and peak heat flow. SHAP analysis identifies Ni content and SOC as the dominant factors controlling thermal runaway temperature, while SOC primarily governs heat release and peak heat flow. Al, Mg, and Mn improve thermal stability by strengthening metal–oxygen bonding and delaying structural transformation, whereas B mainly reduces heat release through surface passivation. Validation with a new cathode composition confirms accurate prediction of SOC-dependent thermal runaway behavior and critical SOC.

25 ENERGY STORAGE↗
DOE OSTI2021

Investigating the impact of cloud-radiative feedbacks on tropical precipitation extremes

Abstract Although societally important, extreme precipitation is difficult to represent in climate models. This study shows one robust aspect of extreme precipitation across models: extreme precipitation over tropical oceans is strengthened through a positive feedback with cloud-radiative effects. This connection is shown for a multi-model ensemble with experiments that make clouds transparent to longwave radiation. In all cases, tropical extreme precipitation reduces without cloud-radiative effects. Qualitatively similar results are presented for one model using the cloud-locking method to remove cloud feedbacks. The reduced extreme precipitation without cloud-radiative feedbacks does not arise from changes in the mean climate. Rather, evidence is presented that cloud-radiative feedbacks enhance organization of convection and most extreme precipitation over tropical oceans occurs within organized systems. This result suggests that climate models must correctly predict cloud structure and properties, as well as capture the essence of organized convection in order to accurately represent extreme rainfall.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗
DOE OSTI2023

Decoupling of catalysis and transition state analog binding from mutations throughout a phosphatase revealed by high-throughput enzymology

Using high-throughput microfluidic enzyme kinetics (HT-MEK), we measured over 9,000 inhibition curves detailing impacts of 1,004 single-site mutations throughout the alkaline phosphatase PafA on binding affinity for two transition state analogs (TSAs), vanadate and tungstate. As predicted by catalytic models invoking transition state complementary, mutations to active site and active-site-contacting residues had highly similar impacts on catalysis and TSA binding. Unexpectedly, most mutations to more distal residues that reduced catalysis had little or no impact on TSA binding and many even increased tungstate affinity. These disparate effects can be accounted for by a model in which distal mutations alter the enzyme’s conformational landscape, increasing the occupancy of microstates that are catalytically less effective but better able to accommodate larger transition state analogs. In support of this ensemble model, glycine substitutions (rather than valine) were more likely to increase tungstate affinity (but not more likely to impact catalysis), presumably due to increased conformational flexibility that allows previously disfavored microstates to increase in occupancy. These results indicate that residues throughout an enzyme provide specificity for the transition state and discriminate against analogs that are larger only by tenths of an Ångström. Thus, engineering enzymes that rival the most powerful natural enzymes will likely require consideration of distal residues that shape the enzyme’s conformational landscape and fine-tune active-site residues. Biologically, the evolution of extensive communication between the active site and remote residues to aid catalysis may have provided the foundation for allostery to make it a highly evolvable trait.

59 BASIC BIOLOGICAL SCIENCES↗