Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluating Ensemble Predictions of South Asian Monsoon Low Pressure System Genesis

Abstract Synoptic-scale vortices known as monsoon low pressure systems (LPSs) frequently produce intense precipitation and hydrological disasters in South Asia, so accurately forecasting LPS genesis is crucial for improving disaster preparedness and response. However, the accuracy of LPS genesis forecasts by numerical weather prediction models has remained unknown. Here, we evaluate the performance of two global ensemble models—the U.S. Global Ensemble Forecast System (GEFS) and the Ensemble Prediction System of the European Centre for Medium-Range Weather Forecasts (ECMWF)—in predicting LPS genesis during the years 2021–22. The GEFS successfully predicted about half the observed LPS genesis events 1–2 days in advance; the ECMWF model captured an additional 10% of observed genesis events. Both models had a false alarm ratio (FAR) of around 50% for 1–2-day lead times. In both ensembles, the control run typically exhibited a higher probability of detection (POD) of observed events and a lower FAR compared to the perturbed ensemble members. However, a consensus forecast, in which genesis is predicted when at least 20% of ensemble members forecast LPS formation, had POD values surpassing those of the control run for all lead times. Moreover, probabilistic predictions of genesis over the Bay of Bengal, where most LPSs form, were skillful, with the fraction of ensemble members predicting LPS formation over a 5-day lead time approximating the observed frequency of genesis, without any adjustment or bias correction.

Suhas, D. L.↗
DOE OSTI2022

Increased Variability of Biomass Burning Emissions in CMIP6 Amplifies Hydrologic Cycle in the CESM2 Large Ensemble

Abstract Historical simulations performed for the Coupled Model Intercomparison Project Phase 6 used biomass burning emissions between 1997 and 2014 containing higher spatial and temporal variability compared to emission inventories specified for earlier years, and compared to emissions used in previous (e.g., CMIP5) simulation intercomparisons. Using the Community Earth System Model version 2 Large Ensemble, we show this increased biomass burning emissions variability leads to amplification of the hydrologic cycle poleward of 40°N. Notably, the high variability of biomass burning emissions leads to increased latent heat fluxes, column‐integrated precipitable water, and precipitation. Greater ocean heat uptake, weaker meridional energy transport from the tropics, greater atmospheric shortwave and longwave absorption, and lower relative humidity act to moderate this hydrologic cycle amplification. Our results suggest it is not only the secular changes (on multidecadal timescales) in biomass burning emissions that impact the hydrologic cycle, but also the shorter timescale variability in emissions.

Heyblom, Kyle B.↗
DOE OSTI2023

A Process Model for ITCZ Narrowing under Warming Highlights Clear-Sky Water Vapor Feedbacks and Gross Moist Stability Changes in AMIP Models

Tropical areas with mean upward motion—and as such the zonal-mean intertropical convergence zone (ITCZ)—are projected to contract under global warming. To understand this process, a simple model based on dry static energy and moisture equations is introduced for zonally symmetric overturning driven by sea surface temperature (SST). Processes governing ascent area fraction and zonal mean precipitation are examined for insight into Atmospheric Model Intercomparison Project (AMIP) simulations. Bulk parameters governing radiative feedbacks and moist static energy transport in the simple model are estimated from the AMIP ensemble. Uniform warming in the simple model produces ascent area contraction and precipitation intensification—similar to observations and climate models. Contributing effects include stronger water vapor radiative feedbacks, weaker cloud-radiative feedbacks, stronger convection-circulation feedbacks, and greater poleward moisture export. The simple model identifies parameters consequential for the inter-AMIP-model spread; an ensemble generated by perturbing parameters governing shortwave water vapor feedbacks and gross moist stability changes under warming tracks inter-AMIP-model variations with a correlation coefficient ~0.46. Here, the simple model also predicts the multimodel mean changes in tropical ascent area and precipitation with reasonable accuracy. Furthermore, the simple model reproduces relationships among ascent area precipitation, ascent strength, and ascent area fraction observed in AMIP models. A substantial portion of the inter-AMIP-model spread is traced to the spread in how moist static energy and vertical velocity profiles change under warming, which in turn impact the gross moist stability in deep convective regions—highlighting the need for observational constraints on these quantities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Data and scripts associated with the manuscript "Using Mutual Information for Global Sensitivity Analysis on Watershed Modeling"

This package contains the data and scripts used in "Using Mutual Information for Global Sensitivity Analysis on Watershed Modeling" (Jiang et al., 2022). The ARW_SWAT.zip file contains the SWAT simulation and the sensitivity analysis result in the American River Watershed. The Portage_SWAT.zip file contains the SWAT simulation and the sensitivity analysis result in the Portage River Watershed. The src folder contains the source code of sensitivity analysis and plotting functions. The notebooks folder contains the Jupyter notebooks for performing sensitivity analysis and other post analyses.Global Sensitivity Analysis (GSA) often is applied to assess the sensitivity of model outputs to their inputs using ensemble simulations. However, increasing model complexity and the associated computational cost have limited the use of most GSA approaches for process-based watershed models. We propose to use Mutual Information (MI) as a computationally efficient GSA method for watershed modeling. Such MI computed from several hundred realizations usually can capture nonlinear relationships between inputs and outputs of interest. We perform MI-based watershed sensitivity analyses in studies of the Portage River Watershed in Ohio and the American River Watershed in Washington. In these studies, MI is used to evaluate the sensitivity of river discharges simulated by the Soil and Water Assessment Tool to no less than 20 parameters for each watershed. Our MI-based sensitivity analyses achieved convergence with about 300~500 realizations, a small fraction of the ensemble size (i.e., several thousand) required by the Sobol method. Nevertheless, MI yields similar sensitivity ranking compared to the Sobol method, especially for sensitive parameters. Our study thus sheds new light on the use of MI as an affordable GSA method for computationally intensive models such as the hyper-resolution, watershed hydrobiogeochemical models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Prescreening-Based Subset Selection for Improving Predictions of Earth System Models With Application to Regional Prediction of Red Tide

We present the ensemble method of prescreening-based subset selection to improve ensemble predictions of Earth system models (ESMs). In the prescreening step, the independent ensemble members are categorized based on their ability to reproduce physically-interpretable features of interest that are regional and problem-specific. The ensemble size is then updated by selecting the subsets that improve the performance of the ensemble prediction using decision relevant metrics. We apply the method to improve the prediction of red tide along the West Florida Shelf in the Gulf of Mexico, which affects coastal water quality and has substantial environmental and socioeconomic impacts on the State of Florida. Red tide is a common name for harmful algal blooms that occur worldwide, which result from large concentrations of aquatic microorganisms, such as dinoflagellate Karenia brevis, a toxic single celled protist. We present ensemble method for improving red tide prediction using the high resolution ESMs of the Coupled Model Intercomparison Project Phase 6 (CMIP6) and reanalysis data. The study results highlight the importance of prescreening-based subset selection with decision relevant metrics in identifying non-representative models, understanding their impact on ensemble prediction, and improving the ensemble prediction. These findings are pertinent to other regional environmental management applications and climate services. Additionally, our analysis follows the FAIR Guiding Principles for scientific data management and stewardship such that data and analysis tools are findable, accessible, interoperable, and reusable. As such, the interactive Colab notebooks developed for data analysis are annotated in the paper. This allows for efficient and transparent testing of the results’ sensitivity to different modeling assumptions. Moreover, this research serves as a starting point to build upon for red tide management, using the publicly available CMIP, Coordinated Regional Downscaling Experiment (CORDEX), and reanalysis data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating Enhanced Reservoir Evaporation Losses From CMIP6‐Based Future Projections in the Contiguous United States

Abstract Enhanced reservoir evaporation has become an emerging concern regarding water loss, especially when compounded with the ever‐increasing water demand. In this study, we evaluated the evaporation rates and losses for 678 major reservoirs (representing nearly 90% of total storage capacity) in the Contiguous United States over historical baseline (1980–2019), near‐term (2020–2039), and mid‐term (2040–2059) future periods. The evaporation rate was estimated using the Lake Evaporation Model (LEM), an advanced lake evaporation model that addresses both heat storage and fetch effects, driven by multi‐ensemble downscaled Coupled Model Intercomparison Projects 6 (CMIP6) projections under the SSP585 emission scenario. The results project that the evaporation loss may increase by 2.5 × 10 7 m 3 /yr through the research period (1980–2059). Among all regions, the Rio Grande is projected to have the largest increasing rate in the near‐term and mid‐term future, with values of 7.11% of 10.25%, respectively. At the seasonal scale, the most significant increase in the evaporation rate is projected during the fall. The evaporation is projected to increase faster than the streamflow over many of the regions in the southwestern US during the summer/fall, suggesting that the shortage of water will be further exacerbated. The climate models contribute the most to the variance, as compared to the other components related to the projection of evaporation losses (e.g., hydrological model, downscaling method, and historical meteorological data set). These findings demonstrate the need to consider accelerated water loss through open water evaporation in long‐term water resources planning across various spatiotemporal scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Anthropogenic Influences on Tornadic Storms

The impact of climate change on severe storms and tornadoes remains uncertain, largely owing to inconsistencies in observational data and limitations of climate models. Here, we performed ensembles of convection-permitting climate model simulations to examine how three tornadic storms would change if similar events were to occur in pre-industrial and future climates. The choice of events includes winter, nocturnal, and spring tornadic storms to provide insight into how the timing and seasonality of storms may affect their response to climate change. Updraft helicity (UH), convective available potential energy (CAPE), storm relative helicity (SRH), and convective inhibition (CIN) were used to determine the favorability for the three tornadic storm events in the different climate states. We found that from the pre-industrial to present, the potential for tornadic storms decreased in the winter event and increased in the nocturnal and spring events. With future climate change, the potential for tornadic storms increased in the winter and nocturnal events in association with increased CAPE, and decreased in the spring event despite greater CAPE.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Are 100 Ensemble Members Enough to Capture the Remote Atmospheric Response to +2°C Arctic Sea Ice Loss?

This study presents results from the Polar Amplification Multimodel Intercomparison Project (PAMIP) single-year time-slice experiments that aim to isolate the atmospheric response to Arctic sea ice loss at global warming levels of +2°C. Using two general circulation models (GCMs), the ensemble size is increased up to 300 ensemble members, beyond the recommended 100 members. After partitioning the response in groups of 100 ensemble members, the reproducibility of the results is evaluated, with a focus on the response of the midlatitude jet streams in the North Atlantic and North Pacific. Both atmosphere-only and coupled ocean–atmosphere PAMIP experiments are analyzed. Substantial differences in the midlatitude response are found among the different experiment subsets, suggesting that 100-member ensembles are still significantly influenced by internal variability, which can mislead conclusions. Despite an overall stronger response, the coupled ocean–atmosphere runs exhibit greater spread due to additional ENSO-related internal variability when the ocean is interactive. The lack of consistency in the response is true for anomalies that are statistically significant according to Student’s t and false discovery rate tests. This is problematic for the multimodel assessment of the response, as some of the spread may be attributed to different model sensitivities whereas it is due to internal variability. Here, we propose a method to overcome this consistency issue that allows for more robust conclusions when only 100 ensemble members are used.

58 GEOSCIENCES↗
DOE OSTI2021

Crack fault diagnosis of rotating machine in nuclear power plant based on ensemble learning

Crack faults in rotating machines can cause machine shutdown or scrapping, endangering the normal operation and safety of nuclear power plants. Intelligent diagnostic techniques based on machine learning have the potential to diagnose crack faults. However, problems such as scarcity of field fault data and high noise of plant measurements pose challenges to the application of machine learning. Here this study proposes an ensemble learning approach to mitigate the negative impacts of the problems. Ensemble learning is a strategy for combining multiple machine learning models into a composite model. The basic idea of ensemble learning is that even if one model makes a mistake, other models can correct it. Case studies based on bearing and gear system fault experiments show that the proposed ensemble learning models have better diagnostic results than the single model in the presence of noise and small data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Computational Response Theory for Dynamics

Quantifying the sensitivity - how a quantity of interest (QoI) varies with respect to a parameter – and response – the representation of a QoI as a function of a parameter - of a computer model of a parametric dynamical system is an important and challenging problem. Traditional methods fail in this context since sensitive dependence on initial conditions implies that the sensitivity and response of a QoI may be ill-conditioned or not well-defined. If a chaotic model has an ergodic attractor, then ergodic averages of QoIs are well-defined quantities and their sensitivity can be used to characterize model sensitivity. The response theorem gives sufficient conditions such that the local forward sensitivity – the derivative with respect to a given parameter - of an ergodic average of a QoI is well-defined. We describe a method based on ergodic and response theory for computing the sensitivity and response of a given QoI with respect to a given parameter in a chaotic model with an ergodic and hyperbolic attractor. This method does not require computation of ensembles of the model with perturbed parameter values. The method is demonstrated and some of the computations are validated on the Lorenz 63 and Lorenz 96 models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Uncertainty quantification for neural network potential foundation models

Abstract For neural network potentials (NNPs) to gain widespread use, researchers must be able to trust model outputs. However, the blackbox nature of neural networks and their inherent stochasticity are often deterrents, especially for foundation models trained over broad swaths of chemical space. Uncertainty information provided at the time of prediction can help reduce aversion to NNPs. In this work, we detail two uncertainty quantification (UQ) methods. Readout ensembling, by finetuning the readout layers of an ensemble of foundation models, provides information about model uncertainty, while quantile regression, by replacing point predictions with distributional predictions, provides information about uncertainty within the underlying training data. We demonstrate our approach with the MACE-MP-0 model, applying UQ to the foundation model and a series of finetuned models. The uncertainties produced by the readout ensemble and quantile methods are demonstrated to be distinct measures by which the quality of the NNP output can be judged.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Partitioning uncertainty in projections of Arctic sea ice

Abstract Improved knowledge of the contributing sources of uncertainty in projections of Arctic sea ice over the 21st century is essential for evaluating impacts of a changing Arctic environment. Here, we consider the role of internal variability, model structure and emissions scenario in projections of Arctic sea-ice area (SIA) by using six single model initial-condition large ensembles and a suite of models participating in Phase 5 of the Coupled Model Intercomparison Project. For projections of September Arctic SIA change, internal variability accounts for as much as 40%–60% of the total uncertainty in the next decade, while emissions scenario dominates uncertainty toward the end of the century. Model structure accounts for 60%–70% of the total uncertainty by mid-century and declines to 30% at the end of the 21st century in the summer months. For projections of wintertime Arctic SIA change, internal variability contributes as much as 50%–60% of the total uncertainty in the next decade and impacts total uncertainty at longer lead times when compared to the summertime. In winter, there exists a considerable scenario dependence of model uncertainty with relatively larger model uncertainty under strong forcing compared to weak forcing. At regional scales, the contribution of internal variability can vary widely and strongly depends on the calendar month and region. For wintertime SIA change in the Greenland-Iceland-Norwegian and Barents Seas, internal variability contributes 60%–70% to the total uncertainty over the coming decades and remains important much longer than in other regions. We further find that the relative contribution of internal variability to total uncertainty is state-dependent and increases as sea ice volume declines. These results demonstrate that internal variability is a significant source of uncertainty in projections of Arctic sea ice.

Bonan, David B. (ORCID:0000000338676009)↗
DOE OSTI2024

Development and Evaluation of Ensemble Learning-based Environmental Methane Detection and Intensity Prediction Models

The environmental impacts of global warming driven by methane (CH 4 ) emissions have catalyzed significant research initiatives in developing novel technologies that enable proactive and rapid detection of CH 4 . Several data-driven machine learning (ML) models were tested to determine how well they identified fugitive CH 4 and its related intensity in the affected areas. Various meteorological characteristics, including wind speed, temperature, pressure, relative humidity, water vapor, and heat flux, were included in the simulation. We used the ensemble learning method to determine the best-performing weighted ensemble ML models built upon several weaker lower-layer ML models to (i) detect the presence of CH 4 as a classification problem and (ii) predict the intensity of CH 4 as a regression problem. The classification model performance for CH 4 detection was evaluated using accuracy, F1 score, Matthew’s Correlation Coefficient (MCC), and the area under the receiver operating characteristic curve (AUC ROC), with the top-performing model being 97.2%, 0.972, 0.945 and 0.995, respectively. The R 2 score was used to evaluate the regression model performance for CH 4 intensity prediction, with the R 2 score of the best-performing model being 0.858. The ML models developed in this study for fugitive CH 4 detection and intensity prediction can be used with fixed environmental sensors deployed on the ground or with sensors mounted on unmanned aerial vehicles (UAVs) for mobile detection.

Majumder, Reek↗
DOE OSTI2021

Assessing Prior Emergent Constraints on Surface Albedo Feedback in CMIP6

An emergent constraint (EC) is a popular model evaluation technique, which offers the potential to reduce intermodel variability in projections of climate change. Two examples have previously been laid out for future surface albedo feedbacks (SAF) stemming from loss of Northern Hemisphere (NH) snow cover (SAF snow ) and sea ice (SAF ice ). These processes also have a modern-day analog that occurs each year as snow and sea ice retreat from their seasonal maxima, which is strongly correlated with future SAF across an ensemble of climate models. The newly released CMIP6 ensemble offers the chance to test prior constraints through out-of-sample verification, an important examination of EC robustness. Here, we show that the SAF snow EC is equally strong in CMIP6 as it was in past generations, while the SAF ice EC is also shown to exist in CMIP6, but with different, slightly weaker characteristics. We find that the CMIP6 mean NH SAF exhibits a global feedback of 0.25 ± 0.05 W m -2 K -1 , or ~61% of the total global albedo feedback, largely in line with prior generations despite its increased climate sensitivity. Additionally, the NH SAF can be broken down into similar contributions from snow and sea ice over the twenty-first century in CMIP6. Crucially, intermodel variability in seasonal SAF snow and SAF ice is largely unchanged from CMIP5 because of poor outlier simulations of snow cover, surface albedo, and sea ice thickness. These outliers act to mask the noted improvement from many models when it comes to SAF ice , and to a lesser extent SAF snow .

58 GEOSCIENCES↗