Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

What Limits Predictive Certainty of Long-Term Carbon Uptake?

Terrestrial biosphere models can help identify physical processes that control carbon dynamics, including land-atmosphere CO 2 fluxes, and have the potential to project the terrestrial ecosystem response to changing climate. It is important to identify ecosystem processes most responsible for model predictive uncertainty and design improved model representation and observational system studies to reduce that uncertainty. Here we identified model parameters that contribute the most uncertainty to long-term (~100 years) projections of net ecosystem exchange, net primary production, and aboveground biomass within a mechanistic terrestrial biosphere model (Ecosystem Demography, version 2.1) ED2. An uncertainty analysis identified parameters that represent the quantum efficiency of light to photosynthetic conversion, leaf respiration and soil-plant water transfer as the highest contributors to model uncertainty regardless of time frame (annual, decadal, and centennial) and output (e.g., net ecosystem exchange, net primary production, aboveground biomass). Contrary to expectations, the contribution of successional processes related to reproduction, competition, and mortality did not increase as the time scale increased. These findings suggest that uncertainty in the parameters governing short-term ecosystem processes remains the most significant bottleneck to reducing predictive uncertainty. Key actions to reduce parameter uncertainty include more leaf-level trait measurements across multiple sites for quantum efficiency and leaf respiration rate. Further, the empirical representation of soil-plant water transfer should be replaced with a mechanistic, hydraulic representation of water flow, which can be constrained with direct measurements. This analysis focused on aboveground ecosystem processes. The impact of belowground carbon cycling, initial conditions, and meteorological forcing should be addressed in future studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Identifying the sources of uncertainty in climate model simulations of solar radiation modification with the G6sulfur and G6solar Geoengineering Model Intercomparison Project (GeoMIP) simulations

We present here results from the Geoengineering Model Intercomparison Project (GeoMIP) simulations for the experiments G6sulfur and G6solar for six Earth system models participating in the Climate Model Intercomparison Project (CMIP) Phase 6. The aim of the experiments is to reduce the warming that results from a high-tier emission scenario (Shared Socioeconomic Pathways SSP5-8.5) to that resulting from a medium-tier emission scenario (SSP2-4.5). These simulations aim to analyze the response of climate models to a reduction in incoming surface radiation as a means to reduce global surface temperatures, and they do so either by simulating a stratospheric sulfate aerosol layer or, in a more idealized way, through a uniform reduction in the solar constant in the model. We find that over the final two decades of this century there are considerable inter-model spreads in the needed injection amounts of sulfate (29 ± 9 Tg-SO 2 /yr between 2081 and 2100), in the latitudinal distribution of the aerosol cloud and in the stratospheric temperature changes resulting from the added aerosol layer. Even in the simpler G6solar experiment, there is a spread in the needed solar dimming to achieve the same global temperature target (1.91 ± 0.44 %). The analyzed models already show significant differences in the response to the increasing CO 2 concentrations for global mean temperatures and global mean precipitation (2.05 K ± 0.42 K and 2.28 ± 0.80 %, respectively, for SSP5-8.5 minus SSP2-4.5 averaged over 2081–2100). With aerosol injection, the differences in how the aerosols spread further change some of the underlying uncertainties, such as the global mean precipitation response (–3.79 ± 0.76 % for G6sulfur compared to –2.07 ± 0.40 % for G6solar against SSP2-4.5 between 2081 and 2100). These differences in the behavior of the aerosols also result in a larger uncertainty in the regional surface temperature response among models in the case of the G6sulfur simulations, suggesting the need to devise various, more specific experiments to single out and resolve particular sources of uncertainty. The spread in the modeled response suggests that a degree of caution is necessary when using these results for assessing specific impacts of geoengineering in various aspects of the Earth system. However, all models agree that compared to a scenario with unmitigated warming, stratospheric aerosol geoengineering has the potential to both globally and locally reduce the increase in surface temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the turbulence simulation overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura White↗
DOE OSTI2014

Interactive Photochemistry in Earth System Models to Assess Uncertainty in Ozone and Greenhouse Gases. Final report

Atmospheric chemistry controls the abundances and hence climate forcing of important greenhouse gases including N 2 O, CH 4 , HFCs, CFCs, and O 3 . Attributing climate change to human activities requires, at a minimum, accurate models of the chemistry and circulation of the atmosphere that relate emissions to abundances. This DOE-funded research provided realistic, yet computationally optimized and affordable, photochemical modules to the Community Earth System Model (CESM) that augment the CESM capability to explore the uncertainty in future stratospheric-tropospheric ozone, stratospheric circulation, and thus the lifetimes of chemically controlled greenhouse gases from climate simulations. To this end, we have successfully implemented Fast-J (radiation algorithm determining key chemical photolysis rates) and Linoz v3.0 (linearized photochemistry for interactive O 3 , N 2 O, NO y and CH 4 ) packages in LLNL-CESM and for the first time demonstrated how change in O2 photolysis rate within its uncertainty range can significantly impact on the stratospheric climate and ozone abundances. From the UCI side, this proposal also helped LLNL develop a CAM-Superfast Chemistry model that was implemented for the IPCC AR5 and contributed chemical-climate simulations to CMIP5.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Strategies for Automation of Model Tuning in Multifidelity Trajectory Uncertainty Propagation

Multi-model Monte Carlo methods are efficient strategies to perform forward uncertainty quantification studies in entry, descent, and landing (EDL) applications. These multi-model methods are based on the classical Monte Carlo estimator, but fuse predictions from several low-fidelity models to obtain estimators with greater precision given a prescribed computational budget. The effectiveness of these approaches relies on the magnitudes of correlations between the low-fidelity models and the high-fidelity model, as well as the relative computational costs of all models. Identifying and exploiting the best trade-off between correlation and cost, which ultimately depends on the selection of hyperparameters in the low-fidelity models, is a task often performed by hand or simply inspired by the deterministic understanding available for a specific application. This work extends a preliminary effort,

Marten Thompson↗
NASA NTRS2019

Uncertainty Quantification of Modeled Electron Backstreaming Failure for the NEXT Ion Thruster

Excessive electron back streaming is one of the primary life-limiting failure modes for gridded ion thrusters. Physics-based modeling of the optics grid erosion and electron back streaming margins is augmented with statistical uncertainty quantification techniques to generate a life expectancy distribution of this particular failure mechanism for the NEXT ion thruster. Generation of distributions instead of a single point estimate provide a more comprehensive picture of thruster failure probabilities and life expectation for various mission applications.

Yim, John T.↗
DOE OSTI2019

On-line Generation and Error Handling for Surrogate Models within Multifidelity Uncertainty Quantification

Uncertainty quantification is recognized as a fundamental task to obtain predictive numerical simulations. However, many realistic engineering applications require complex and computationally expensive high-fidelity numerical simulations for the accurate characterization of the system responses. Moreover, complex physical models and extreme operative conditions can easily lead to hundreds of uncertain parameters that need to be propagated through high-fidelity codes. Under these circumstances, a single fidelity approach, i.e. a workflow that only uses high-fidelity simulations to perform the uncertainty quantification task, is unfeasible due to the prohibitive overall computational cost. In recent years, multifidelity strategies have been introduced to overcome this issue. The core idea of this family of methods is to combine simulations with varying levels of fidelity/accuracy in order to obtain the multifidelity estimators or surrogates with the same accuracy of their single fidelity counterparts at a much lower computational cost. This goal is usually accomplished by defining a prioria sequence of discretization levels or physical modeling assumptions that can be used to decrease the complexity of a numerical realization and thus its computational cost. However ,less attention has been dedicated to low-fidelity models that can be built directly from the small number of high-fidelity simulations available. In this work we focus our attention on Reduced-Order Models that can be considered a particular class of data-driven approaches. Our main goal is to explore the combination of multifidelity uncertainty quantification and reduced-order models to obtain an efficient framework for propagating uncertainties through expensive numerical codes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Model Validation and Uncertainty Quantification on the KRUSTY Microreactor Design Using GRIFFIN Neutron Transport Code [Poster]

Argonne National Laboratory (ANL) and INL have developed a GRIFFIN steady state neutronics model for the multiphysics simulations of the Kilopower Reactor Using Sterling TechnologY (KRUSTY) microreactor in the Multiphysics Object Oriented Simulation Environment (MOOSE). The reliability of such deterministic neutronics models can be validated by comparing with computations from Monte Carlo codes (e.g. MCNP, SERPENT, OpenMC, Shift, etc). Furthermore, potential modeling/design improvements can be identified by incorporating uncertainty quantification (UQ), which can be performed by MOOSE’s Stochastic Tools Module (STM). KRUSTY is a prototype for a 5-kW thermal nuclear-powered space reactor. Its primary components consist of nuclear fuel, heat pipes, a control rod, a reflector, and the shielding. The fuel consists of 3 stacked U-7.65Mo cylinders with a hole in the center for the control rod. 8 liquid sodium heat pipes transfer fission energy from the solid fuel block to the Sterling power conversion system where the energy is extracted, and the cooled sodium flows back to the core via capillary action . The movable Boron Carbide control rod regulates the neutron population during startup or when a reactor temperature boost is needed . The beryllium oxide reflector is in 3 places in the reactor; it surrounds the core axially, it lies beneath the core on a platen, and it is present in the shim. The axial and lower reflectors rest on an adjustable stainless-steel platen that moves upward to cover the fuel and help the reactor reach criticality. Lastly, radial stainless steel surrounds the core offering protection from radiation exposure .

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2017

Role of Forcing Uncertainty and Background Model Error Characterization in Snow Data Assimilation

Accurate specification of the model error covariances in data assimilation systems is a challenging issue. Ensemble land data assimilation methods rely on stochastic perturbations of input forcing and model prognostic fields for developing representations of input model error covariances. This article examines the limitations of using a single forcing dataset for specifying forcing uncertainty inputs for assimilating snow depth retrievals. Using an idealized data assimilation experiment, the article demonstrates that the use of hybrid forcing input strategies (either through the use of an ensemble of forcing products or through the added use of the forcing climatology) provide a better characterization of the background model error, which leads to improved data assimilation results, especially during the snow accumulation and melt-time periods. The use of hybrid forcing ensembles is then employed for assimilating snow depth retrievals from the AMSR2 (Advanced Microwave Scanning Radiometer 2) instrument over two domains in the continental USA with different snow evolution characteristics. Over a region near the Great Lakes, where the snow evolution tends to be ephemeral, the use of hybrid forcing ensembles provides significant improvements relative to the use of a single forcing dataset. Over the Colorado headwaters characterized by large snow accumulation, the impact of using the forcing ensemble is less prominent and is largely limited to the snow transition time periods. The results of the article demonstrate that improving the background model error through the use of a forcing ensemble enables the assimilation system to better incorporate the observational information.

assimilation↗
DOE OSTI2015

Definition and solution of a stochastic inverse problem for the Manning’s n parameter field in hydrodynamic models

The uncertainty in spatially heterogeneous Manning’s n fields is quantified using a novel formulation and numerical solution of stochastic inverse problems for physics-based models. The uncertainty is quantified in terms of a probability measure and the physics-based model considered here is the state-of-the-art ADCIRC model although the presented methodology applies to other hydrodynamic models. An accessible overview of the formulation and solution of the stochastic inverse problem in a mathematically rigorous framework based on measure theory is presented in this paper. Technical details that arise in practice by applying the framework to determine the Manning’s n parameter field in a shallow water equation model used for coastal hydrodynamics are presented and an efficient computational algorithm and open source software package are developed. A new notion of “condition” for the stochastic inverse problem is defined and analyzed as it relates to the computation of probabilities. Finally, this notion of condition is investigated to determine effective output quantities of interest of maximum water elevations to use for the inverse problem for the Manning’s n parameter and the effect on model predictions is analyzed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗
DOE OSTI2026

Using PyBioNetFit to leverage qualitative and quantitative data in biological model parameterization and uncertainty quantification

Data generated in studies of cellular regulatory systems are often qualitative. For example, measurements of signaling readouts in the presence and absence of mutations may reveal a rank ordering of responses across conditions but not the precise extents of mutation-induced differences. Qualitative data are often ignored by mathematical modelers or are considered in an ad hoc manner, as in the study of Kocieniewski and Lipniacki (2013) [Phys Biol 10: 035006], which was focused on the roles of MEK isoforms in ERK activation. In this earlier study, model parameter values were tuned manually to obtain consistency with a combination of qualitative and quantitative data. This approach is not reproducible, nor does it provide insights into parametric or prediction uncertainties. Here, starting from the same data and the same ordinary differential equation (ODE) model structure, we generate formalized statements of qualitative observations, making these observations more reusable, and we improve the model parameterization procedure by applying a systematic and automated approach enabled by the software package PyBioNetFit. We also demonstrate uncertainty quantification (UQ), which was absent in the original study. Our results show that PyBioNetFit enables qualitative data to be leveraged, together with quantitative data, in parameterization of systems biology models and facilitates UQ. These capabilities are important for reliable estimation of model parameters and model analyses in studies of cellular regulatory systems and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Whitepaper prepared for DOE Workshop on Integrated Simulations for Magnetic Fusion Energy Sciences: Topic E: Beyond interpretive simulations

Predictive simulations of magnetic confinement fusion and burning plasmas will require the quantification of all uncertainties and errors relating to the simulation capabilities. These include: discretization error (temporal and spatial); incomplete convergence error (nonlinear, linear, etc.); uncertainties in input data (initial conditions, boundary conditions, coefficients, thermo-physical properties, source terms, etc.); and uncertainties in the component models (the specific form and parameter values).13 Typically, there is a focus on model parameter uncertainties but uncertainties about which model to use and about the bias or discrepancy of a particular model (sometimes called model form error) often dominate parameter uncertainty. This whitepaper addresses the challenges of performing uncertainty quantification (UQ) for expensive computational models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Model Structural Inference Using Local Dynamic Operators

This paper focuses on the problem of quantifying the effects of model-structure uncertainty in the context of time-evolving dynamical systems. This is motivated by multi-model uncertainty in computer physics simulations: developers often make different modeling choices in numerical approximations and process simplifications, leading to different numerical codes that ostensibly represent the same underlying dynamics. We consider model-structure inference as a two-step methodology: the first step is to perform system identification on numerical codes for which it is possible to observe the full state; the second step is structural uncertainty quantification, in which the goal is to search candidate models "close" to the numerical code surrogates for those that best match a quantity of interest (QOI) from some empirical data sets. Here, we (1) define a discrete, local representation of the structure of a partial differential equation, which we refer to as the "local dynamical operator" (LDO); (2) identify model structure nonintrusively from numerical code output; (3) nonintrusively construct a reduced-order model (ROM) of the numerical model through POD-DEIM-Galerkin projection; (4) perturb the ROM dynamics to approximate the behavior of alternate model structures; and (5) apply Bayesian inference and energy conservation laws to calibrate a LDO to a given QOI. We demonstrate these techniques using the two-dimensional rotating shallow water equations as an example system.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can be used to either improve the model through calibration or quantify the model-form uncertainty. This work focuses on estimating the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given the uncertainty in both the simulation and experimental data. A procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs is outlined. The work also assesses the impact of using different high-fidelity solvers and different turbulence models. The goal of performing this comparison is to provide a quantifiable measurement of the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis is also performed to get a model-form uncertainty for this type of analysis. The two high-fidelity CFD solvers used here are VULCAN-CFD and FUN3D, and the low-fidelity results comes from Cart3D.The experimental data comes from the 20-inch Mach 6 Tunnel located at NASA Langley Research Center. The work here shows that the models used tend to under-predict the drag and moment aerodynamic coefficients for this type of design leading to a model-form uncertainty estimate which can account for up to an 86% of the total uncertainty in the model predictions.

Laura M White↗
DOE OSTI2025

Identification Uncertainty in Inverse Material Model Parameter Determination: A Sensitivity‐Based Decision Process for Load Path Selection

This research proposes a sensitivity-based framework for selecting the optimal prescribed loading path for a biaxial cruciform specimen. Optimality here is determined by the direction and magnitude of the prescribed displacement that minimizes the influence of random noise on the material model parameter identification. Using simulated experimental data based on finite element simulation, in this work, we identify the material model parameters of a Ludwik hardening model and plane stress implementation of the Hill-48 yield criterion using finite element model updating (FEMU). Our analysis reveals that the identification (or estimator) uncertainty of model parameters depends on the displacement boundary conditions (i.e., loading sequence) and the ground-truth value of the individual parameters. Optimal experimental design (OED) criteria based on the Fisher information matrix were investigated to mitigate indecision in the choice of optimal load path when the identification uncertainty of different material model parameters optimized at different load paths. The determinant of the Fisher information matrix was chosen here as the more useful metric due to its ability to capture uncertainty of the most influential material model parameters. The proposed framework demonstrates potential for real-time automated load step selection using scalar criteria derived prior to mechanical loading. The framework can be generalized to other geometries, boundary conditions and material models, allowing this procedure to be utilized for different experimental configurations and materials.

Fayad, Samuel S. [University of Illinois at Urbana↗
NASA NTRS2007

Toward Scientific Numerical Modeling

Ultimately, scientific numerical models need quantified output uncertainties so that modeling can evolve to better match reality. Documenting model input uncertainties and verifying that numerical models are translated into code correctly, however, are necessary first steps toward that goal. Without known input parameter uncertainties, model sensitivities are all one can determine, and without code verification, output uncertainties are simply not reliable. To address these two shortcomings, two proposals are offered: (1) an unobtrusive mechanism to document input parameter uncertainties in situ and (2) an adaptation of the Scientific Method to numerical model development and deployment. Because these two steps require changes in the computational simulation community to bear fruit, they are presented in terms of the Beckhard-Harris-Gleicher change model.

Kleb, Bil↗