Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Comparison of Mesoscale Model Setups for Offshore Wind Resource Assessment: A New Jersey Case Study

As the offshore wind energy industry begins to emerge on the U.S. northeast coast, there is an urgent need for an accurate characterization of the offshore wind resource. The offshore regime features various resource characteristics not seen onshore, including frequent coastal low-level jets, non-steady surface conditions (e.g. waves), complex air-sea and land-sea interactions, and coastal mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed. mesoscale circulations (e.g. sea breeze). An accurate characterization of these phenomena in mesoscale models is critical to support accurate energy production estimates and forecasting for future offshore wind farms. However, a robust validation of mesoscale model performance in the offshore U.S. has been limited due to sparse data and difficulty obtaining offshore measurements. Consequently, it is unclear how mesoscale models perform offshore and which suite of parameterizations and input data are best suited for accurate resource characterization. To begin addressing this knowledge gap, the National Renewable Energy Laboratory, in collaboration with the Rutgers Center for Ocean Observing Leadership, conducted a mesoscale model validation campaign in the offshore environment. The Weather Research and Forecasting (WRF) model was assessed and the New Jersey offshore coastal area served as the validation domain. An ensemble of WRF simulations conducted over a one-year period sampled from a range of model setups, including different reanalysis and forecast data inputs, sea surface temperature data inputs, planetary boundary layer parameterizations, and WRF versions. The performance of each ensemble member was validated against a network of observations including offshore floating lidars, coastal met towers, offshore platform measurements, and offshore buoys. Model performance was assessed on annual, seasonal, and diurnal scales with particular emphasis on the vertical wind speed profile and temperature stratification. Preliminary results from this validation work will be presented here. The key WRF inputs and parameters driving changes in the modeled wind resource will be discussed and preliminary recommendations on WRF setups for offshore wind resource modeling will be proposed. The application of this validation exercise to other proposed offshore wind energy areas in the U.S. will also be discussed.

17 WIND ENERGY↗

Development of uncertainty-aware equation-of-state models: Application to copper

Sophisticated hydrodynamic codes are commonly used to understand and predict events relevant to natural and applied sciences. The degree to which these simulations reflect reality, however, is dependent on how well we understand the materials and underlying physics involved. These research communities need material models that communicate the uncertainty in the physical properties, which at their basest form comes from the uncertainty in the underlying experimental measurements. Additionally, we have constructed a new framework for using both experimental measurements and the associated experimental uncertainties to build equation-of-state models that reflect not only current best measurements but also the accuracy of those measurements. This method had been used to construct an ensemble of equation-of-state models for copper that communicates the experimental uncertainties in the data through the equation-of-state model, which is available for application in any simulation metric of interest.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Bayesian Calibration of Nuclear Graphite Property Models Accounting for Model Inadequacy and Impacts on Component Performance

Nuclear-grade structural graphite is extensively utilized in the core designs of various advanced nuclear reactors. In the reactor environment, graphite is subjected to prolonged exposure to extreme conditions, including high temperatures, radiation, and potentially molten salt and oxygen. Such exposure can induce several degradation mechanisms in graphite, including nonuniform volumetric strains caused by irradiation and thermal expansion, leading to stresses that may compromise the performance of graphite components. Assessing component integrity requires accurate models of graphite's thermomechanical response. This report documents the Bayesian calibration of thermomechanical properties for nuclear-grade graphite and their application to graphite component modeling and simulation using the Grizzly code. As part of this work, uncertainty-quantified models were developed for the elastic modulus, coefficient of thermal expansion, irradiation-induced dimensional change, and irradiation-induced creep for graphite grades IG-110, NBG-18, NBG-17, PCEA, and 2114. Using a hierarchical Bayesian approach, multiple experimental data sources were combined to develop Gaussian process models for the properties. Using the Kennedy O'Hagan framework, the uncertainties due to inadequacies in the model and the inherent spread in the experimental data were quantified for three different models. These uncertainty-quantified models, with a model-form correction, were subsequently applied to a coupled-physics simulation of representative graphite components, revealing that the uncertainties have a large impact on the components' deformation.

36 - MATERIALS SCIENCE↗

Sensitivity Analysis of the Human Research Program’s Impact 1.0 Model

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Leave One Out (LOO) are methods of conducting sensitivity analysis on non-linear simulation models like the IMPACT Model. The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The “partial” part is due to the adjustments made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. LOO removes a medical condition from test suite and calculates the change in the outcome. This is used to identify the influence of the condition input in the model The inputs to the sensitivity procedures include the number of occurrences of each of the one hundred plus IMPACT medical conditions generated over the simulations, and the IMPACT outputs from the MEDPRAT mathematical model. The outputs total task time lost (TTL), number of return to definitive care (RTDC), and number of loss of crew lives (LOCL). The IMPACT team will report the results of using PRCC and LOO on IMPACT 1.0. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty, and input values could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMPACT 1.0.

Sensitivity Anaylsis↗

Exploring the Model Design Space for Battery Health Management

Battery Health Management (BHM) is a core enabling technology for the success and widespread adoption of the emerging electric vehicles of today. Although battery chemistries have been studied in detail in literature, an accurate run-time battery life prediction algorithm has eluded us. Current reliability-based techniques are insufficient to manage the use of such batteries when they are an active power source with frequently varying loads in uncertain environments. The amount of usable charge of a battery for a given discharge profile is not only dependent on the starting state-of-charge (SOC), but also other factors like battery health and the discharge or load profile imposed. This paper presents a Particle Filter (PF) based BHM framework with plug-and-play modules for battery models and uncertainty management. The batteries are modeled at three different levels of granularity with associated uncertainty distributions, encoding the basic electrochemical processes of a Lithium-polymer battery. The effects of different choices in the model design space are explored in the context of prediction performance in an electric unmanned aerial vehicle (UAV) application with emulated flight profiles.

Saha, Bhaskar↗

Co-optimization of CO 2 -EOR and Storage Processes under Geological Uncertainty

This paper presents an integrated numerical framework to co-optimize EOR and CO 2 storage performance in the Farnsworth field unit (FWU), Ochiltree County, Texas. The framework includes a field-scale compositional reservoir flow model, an uncertainty quantification model and a neural network optimization process. The reservoir flow model has been constructed based on the field geophysical, geological, and engineering data. A laboratory fluid analysis was tuned to an equation of state and subsequently used to predict the thermodynamic minimum miscible pressure (MMP). A history match of primary and secondary recovery processes was conducted to estimate the reservoir and multiphase flow parameters as the baseline case for analyzing the effect of recycling produced gas, infill drilling and water alternating gas (WAG) cycles on oil recovery and CO 2 storage. A multi-objective optimization model was defined for maximizing both oil recovery and CO 2 storage. The uncertainty quantification model comprising the Latin Hypercube sampling, Monte Carlo simulation, and sensitivity analysis, was used to study the effects of uncertain variables on the defined objective functions. Uncertain variables such as bottom hole injection pressure, WAG cycle, injection and production group rates, and gas-oil ratio among others were selected. The most significant variables were selected as control variables to be used for the optimization process. A neural network optimization algorithm was utilized to optimize the objective function both with and without geological uncertainty. The vertical permeability anisotropy (Kv/Kh) was selected as one of the uncertain parameters in the optimization process. The simulation results were compared to a scenario baseline case that predicted CO 2 storage of 74%. The results showed an improved approach for optimizing oil recovery and CO 2 storage in the FWU. The optimization process predicted more than 94% of CO 2 storage and most importantly about 28% of incremental oil recovery. The sensitivity analysis reduced the number of control variables to decrease computational time. A risk aversion factor was used to represent results at various confidence levels to assist management in the decision-making process. The defined objective functions were proved to be a robust approach to co-optimize oil recovery and CO 2 storage. The Farnsworth CO 2 project will serve as a benchmark for future CO 2 –EOR or CCUS projects in the Anadarko basin or geologically similar basins throughout the world.

54 ENVIRONMENTAL SCIENCES↗

Global land carbon sink response to temperature and precipitation varies with ENSO phase

Climate variability associated with the El Niño-Southern Oscillation (ENSO) and its consequent impacts on land carbon sink interannual variability have been used as a basis for investigating carbon cycle responses to climate variability more broadly, and to inform the sensitivity of the tropical carbon budget to climate change. Past studies have presented opposing views about whether temperature or precipitation is the primary factor driving the response of the land carbon sink to ENSO. We show that the dominant driver varies with ENSO phase. And whereas tropical temperature explains sink dynamics following El Niño conditions (r TG,P = 0.59, p < 0.01), the post La Niña sink is driven largely by tropical precipitation (r PG,T= -0.46, p = 0.04). This finding points to an ENSO-phase-dependent interplay between water availability and temperature in controlling the carbon uptake response to climate variations in tropical ecosystems. Furthermore, we find that none of a suite of ten contemporary terrestrial biosphere models captures these ENSO-phase-dependent responses, highlighting a key uncertainty in modeling climate impacts on the future of the global land carbon sink.

54 ENVIRONMENTAL SCIENCES↗

DISTRIBUTION AND RANGE OF RADIONUCLIDE SORPTION COEFFICIENTS IN A SAVANNAH RIVER SITE SUBSURFACE: STOCHASTIC MODELING CONSIDERATIONS

The uncertainty associated with the sorption coefficient, or K{sub d} value, is one of the key uncertainties in estimating risk associated with burying low-level nuclear waste in the subsurface. The objective of this study was to measure >648 K{sub d} values and provide a measure of the range and distribution (normal or log-normal) of radionuclide K{sub d} values appropriate for the E-Area disposal site, within the Savannah River Site, near Aiken South Carolina. The 95% confidence level for the mean K{sub d} was twice the mean in the Aquifer Zone (18-30.5 m depth), equal to the mean for the Upper Vadose Zone (3.3-10 m depth), and half the mean for the Lower Vadose Zone (3.10-18 m depth). The distribution of K{sub d} values was log normal in the Upper Vadose Zone and Aquifer Zone, and normal in the Lower Vadose Zone. To our knowledge, this is the first report of natural radionuclide Kd variability in the literature. Using ranges and distribution coefficients that are specific to the hydrostratigraphic unit improved model accuracy and reduced model uncertainty. Unfortunately, extension of these conclusions to other sites is likely not appropriate given that each site has its own sources of hydrogeological variability. However, this study provides one of the first examples of the development stochastic ranges and distributions of K{sub d} values for a hydrological unit for stochastic modeling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Properties and uncertainties of scalar field models of dark energy with barotropic equation of state

The dynamics of expansion and large scale structure formation in the multicomponent Universe with dark energy modeled by the minimally coupled scalar field with generalized linear barotropic equation of state are analyzed. It is shown that the past dynamics of expansion and future of the Universe - eternal accelerated expansion or turnaround and collapse - are completely defined by the current energy density of a scalar field and relation between its current and early equation of state parameters. The clustering properties of such models of dark energy and their imprints in the power spectrum of matter density perturbations depend on the same relation and, additionally, on the 'effective sound speed' of a scalar field, defined by its Lagrangian. It is concluded that such scalar fields with different values of these parameters are distinguishable in principle. This gives the possibility to constrain them by confronting the theoretical predictions with the corresponding observational data. For that we have used the 7-year Wilkinson Microwave Anisotropy Probe data on cosmic microwave background anisotropies, the Union2 data set on Supernovae Ia and the seventh data release of the Sloan Digital Sky Survey data on luminous red galaxies space distribution. Using the Markov Chain Monte Carlo technique the marginalized posterior and mean likelihood distributions are computed for the scalar fields with two different Lagrangians: Klein-Gordon and Dirac-Born-Infeld ones. The properties of such scalar field models of dark energy with best fitting parameters and uncertainties of their determination are also analyzed in the paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗

To use or not to use synthetic stellar spectra in population synthesis models?

ABSTRACT Stellar population synthesis (SPS) models are invaluable to study star clusters and galaxies. They provide means to extract stellar masses, stellar ages, star formation histories, chemical enrichment, and dust content of galaxies from their integrated spectral energy distributions, colours, or spectra. As most models, they contain uncertainties that can hamper our ability to model and interpret observed spectra. This work aims at studying a specific source of model uncertainty: the choice of an empirical versus a synthetic stellar spectral library. Empirical libraries suffer from limited coverage of parameter space, while synthetic libraries suffer from modelling inaccuracies. Given our current inability to have both ideal stellar-parameter coverage with ideal stellar spectra, what should one favour: better coverage of the parameters (synthetic library) or better spectra on a star-by-star basis (empirical library)? To study this question, we build a synthetic stellar library mimicking the coverage of an empirical library, and SPS models with different choices of stellar library tailored to these investigations. Through the comparison of model predictions and the spectral fitting of a sample of nearby galaxies, we learned that predicted colours are more affected by the coverage effect than the choice of a synthetic versus empirical library; the effects on predicted spectral indices are multiple and defy simple conclusions; derived galaxy ages are virtually unaffected by the choice of the library, but are underestimated when SPS models with limited parameter coverage are used; metallicities are robust against limited HRD coverage, but are underestimated when using synthetic libraries.

Coelho, Paula R. T.↗

Using Bayesian Networks for Sensitivity Analysis of Complex Biogeochemical Models

Sensitivity analysis is a vital tool in numerical modeling to identify important parameters and processes that contribute to the overall uncertainty in model outputs. We developed a new sensitivity analysis method to quantify the relative importance of uncertain model processes that contain multiple uncertain parameters. The method is based on the concepts of Bayesian networks (BNs) to account for complex hierarchical uncertainty structure of a model system. We derived a new set of sensitivity indices using the methodology of variance-based global sensitivity analysis with the Bayesian inference. The framework is capable of representing the detailed uncertainty information of a complex model system using BNs and affords flexible grouping of different uncertain inputs given their characteristics and dependency structures. We have implemented the method on a real-world biogeochemical model at the groundwater-surface water interface within the Hanford Site’s 300 Area. The uncertainty sources of the model were first grouped into forcing scenario and three different processes based on our understanding of the complex system. The sensitivity analysis results indicate that both the reactive transport and groundwater flow processes are important sources of uncertainty for carbon-consumption predictions. Within the groundwater flow process, the structure of geological formations is more important than the permeability heterogeneity within a given geological formation. Our new sensitivity analysis framework based on BNs offers substantial flexibility for investigating the importance of combinations of interacting uncertainty sources in a hierarchical order, and it is expected to be applicable to a wide range of multi-physics models for complex systems.

Dai, Heng↗

The inclusion of uncertainty in circularity transition modeling: A case study on wind turbine blade end-of-life management

The transition to a more circular economy (CE) is complex and hard to predict, including in sustainable energy technologies. Many sources of uncertainty make it challenging to model CE scenarios and their potential benefits. As an example, the high variability in costs and revenues of different recycling options makes future wind turbine blade recycling highly uncertain. To better understand this challenge, the circular economy, life cycle assessment and visualization (CELAVI) framework - a discrete event simulation and life cycle assessment framework - is modified to incorporate uncertainty analysis capabilities. Moreover, a 3-step procedure that covers different aspects of uncertainty in CE studies and includes a Monte-Carlo analysis is proposed. The procedure is tested in a case study on wind turbine blade recycling using CELAVI. Results highlight that grinding and landfilling costs are the most influential parameters for wind power circularity. The model's output coefficients of variation (when input parameter uncertainties are propagated) are between 92% and 384% depending on the indicator. The approach developed in this study may help researchers and decision-makers who study circularity prioritize their data collection effort. Finally, our method contributes to a mounting yet critical body of research: the measurement of uncertainty in circularity transitions.

17 WIND ENERGY↗

Improved statistical models for limited datasets in uncertainty quantification using stochastic collocation

This paper presents a data-driven framework for performing uncertainty quantification (UQ) by choosing a stochastic model that accurately describes the sources of uncertainty in a system. This model is propagated through an appropriate response surface function that approximates the behavior of this system using stochastic collocation. Given a sample of data describing the uncertainty in the inputs, our goal is to estimate a probability density function (PDF) using the kernel moment matching (KMM) method so that this PDF can be used to accurately reproduce statistics like mean and variance of the response surface function. Instead of constraining the PDF to be optimal for a particular response function, we show that we can use the properties of stochastic collocation to make the estimated PDF optimal for a wide variety of response functions. We contrast this method with other traditional procedures that rely on the Maximum Likelihood approach, like kernel density estimation (KDE) and its adaptive modification (AKDE). We argue that this modified KMM method tries to preserve what is known from the given data and is the better approach when the available data is limited in quantity. We test the performance of these methods for both univariate and multivariate density estimation by sampling random datasets from known PDFs and then measuring the accuracy of the estimated PDFs, using the known PDF as a reference. Comparing the output mean and variance estimated with the empirical moments using the raw data sample as well as the actual moments using the known PDF, we show that the KMM method performs better than KDE and AKDE in predicting these moments with greater accuracy. This improvement in accuracy is also demonstrated for the case of UQ in electrostatic and electrothermomechanical microactuators. We show how our framework results in the accurate computation of statistics in micromechanical systems.

97 MATHEMATICS AND COMPUTING↗

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗