Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty

Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by partial differential equations (PDEs) remains prohibitive with black-box Markov chain Monte Carlo (MCMC) methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (~ 50×) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework.

97 MATHEMATICS AND COMPUTING↗

The effect of modeling dose uncertainty on low-boom community noise dose-response curves

In logistic dose-response modeling, failing to account for uncertainty in estimated doses can cause an artificial flattening or attenuation of the slope of the summary curve. In Lee et al. [J. Acoust. Soc. Am. 147(4), pp. 2222-2234 (2020)], data from two NASA low-amplitude sonic boom community noise survey tests were modeled using a Bayesian multilevel logistic regression (MLR) statistical model that assumed there was no uncertainty in the noise dose estimates. However, in these community tests, the noise dose uncertainty was estimated by Page et al. [NASA/CR-2014-218180 and NASA/CR-2020-220589/Volume I] using a leave-one-out method. In the current work, a term was added to extend the Bayesian MLR model to account for the estimated noise dose uncertainty quantified in the Page et al. analyses. This uncertainty term was included in two ways, either as classical or as Berkson uncertainty, and yield similar results. When the uncertainty is accounted for in the Bayesian MLR model, the dose-response curves become 5-10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). This result is encouraging for future X-59 community tests whose survey area will be sparsely populated with noise monitors.

X-59↗

Modeling the Uncertainty of Fischer-Tropsch Jet Fuel Life Cycle Inventories with Monte Carlo Simulation [Slides]

This presentation discusses the use of Monte Carlo simulation to model the uncertainty in a life cycle inventory of the Gasification Systems of coal and biomass. While the inventory is dominated by carbon dioxide emissions from the Adv. Combustion Systems of the fuel, small changes to the feedstocks that are used to make the fuel can make the difference in complying with the Energy Independence and Security Act of 2007.

01 COAL, LIGNITE, AND PEAT↗

Effect of Tropical Nonconvective Condensation on Uncertainty in Modeled Projections of Rainfall

Abstract We find that part of the uncertainty in the amplitude and pattern of the modeled precipitation response to CO2 forcing traces to tropical condensation not directly involved with parameterized convection. The fraction of tropical rainfall associated with large-scale condensation can vary from a few percent to well over half depending on model details and parameter settings. In turn, because of the coupling between condensation and tropical circulation, the different ways model assumptions affect the large-scale rainfall fraction also affect the patterns of the response within individual models. In two single-model ensembles based on the National Center for Atmospheric Research (NCAR) Community Atmosphere Model (CAM), versions 3.1 and 5.3, we find strong correlations between the fraction of tropical large-scale rain and both climatological rainfall and circulation and the response to CO2 forcing. While the effects of an increasing tropical large-scale rain fraction are opposite in some ways in the two ensembles—for example, the Hadley circulation weakens with the large-scale rainfall fraction in the CAM3.1 ensemble while strengthening in the CAM5.3 ensemble—we can nonetheless understand these different effects in terms of the relationship between latent heating and circulation, and we propose explanations for each ensemble. We compare these results with data from phase 5 of the Coupled Model Intercomparison Project (CMIP5), for which some of the same patterns hold. Given the importance of this partitioning, there is a need for constraining this source of uncertainty using observations. However, since a “large-scale rainfall fraction” is a modeling construct, it is not clear how observations may be used to test various modeling assumptions determining this fraction.

54 ENVIRONMENTAL SCIENCES↗

Co-Evolving Climate Models under Uncertainty to Improve Predictive Skill

Focal Area: Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models Science Challenge: Advances in modeling of climate and improved observational capabilities have led to great improvements in understanding large-scale historical climate effects. It however remains a challenge to reliably predict the risk of fine-scale regional climate events on human systems even as such risks are on the rise because warmer and wetter climates are more prone to hydrometeorological extremes,

54 ENVIRONMENTAL SCIENCES↗

Deep Direct-Use Feasibility Study Numerical Modeling and Uncertainty Analysis using iTOUGH2 for West Virginia University

To reduce the geothermal exploration risk, a feasibility study is performed for a deep direct-use system proposed at the West Virginia University (WVU) Morgantown campus. This study applies numerical simulations to investigate reservoir impedance and thermal production. Because of the great depth of the geothermal reservoir, few data are available to characterize reservoir features and properties. As a result, the study focuses on the following three aspects: 1. model choice for predicting reservoir impedance and thermal breakthrough: after investigating three potential models (one single permeability model and two dual permeability models) for flow through fractured rock, it is decided to use single permeability model for further analysis; 2. well placement (horizontal vs. vertical) options: horizontal well placement seems to be more robust to heterogeneity and the impedance is more acceptable; 3. Prediction uncertainty: the most influential parameters are identified using a First-Order-Second-Moment uncertainty propagation analysis, and the uncertain range of the model predictions is estimated by performing a Monte Carlo simulation. Heterogeneity has a large impact on the perdition, therefore, is considered in the predictive model and uncertainty analysis. The numerical model results and uncertainty analysis are used for economic analysis. The dataset submitted here support the described study. Manuscript is submitted to Geothermics, will be linked once paper is accepted.

15 GEOTHERMAL ENERGY↗

Advances in Aircraft System Identification at NASA Langley Research Center

Advances in aircraft system identification at NASA Langley Research Center are discussed. The relevant time period includes the years since the last summary paper of this kind, which was published in the Journal of Aircraft in 2005. Research advances were achieved in flight test experiment design, frequency-domain modeling, real-time autonomous global modeling, rapid simulation development and updating, dynamic modeling in turbulence, flight data corrections, model uncertainty characterization, and aeroelastic modeling using distributed sensing. Possible future developments in the field are identified.

Aircraft system identification↗

Uncertainty in Modeling Dust Mass Balance and Radiative Forcing from Size Parameterization

This study examines the uncertainties in simulating mass balance and radiative forcing of mineral dust due to biases in the aerosol size parameterization. Simulations are conducted quasi-globally (180oW-180oE and 60oS-70oN) using the WRF24 Chem model with three different approaches to represent aerosol size distribution (8-bin, 4-bin, and 3-mode). The biases in the 3-mode or 4-bin approaches against a relatively more accurate 8-bin approach in simulating dust mass balance and radiative forcing are identified. Compared to the 8-bin approach, the 4-bin approach simulates similar but coarser size distributions of dust particles in the atmosphere, while the 3-mode pproach retains more fine dust particles but fewer coarse dust particles due to its prescribed og of each mode. Although the 3-mode approach yields up to 10 days longer dust mass lifetime over the remote oceanic regions than the 8-bin approach, the three size approaches produce similar dust mass lifetime (3.2 days to 3.5 days) on quasi-global average, reflecting that the global dust mass lifetime is mainly determined by the dust mass lifetime near the dust source regions. With the same global dust emission (~6000 Tg yr-1), the 8-bin approach produces a dust mass loading of 39 Tg, while the 4-bin and 3-mode approaches produce 3% (40.2 Tg) and 25% (49.1 Tg) higher dust mass loading, respectively. The difference in dust mass loading between the 8-bin approach and the 4-bin or 3-mode approaches has large spatial variations, with generally smaller relative difference (<10%) near the surface over the dust source regions. The three size approaches also result in significantly different dry and wet deposition fluxes and number concentrations of dust. The difference in dust aerosol optical depth (AOD) (a factor of 3) among the three size approaches is much larger than their difference (25%) in dust mass loading. Compared to the 8-bin approach, the 4-bin approach yields stronger dust absorptivity, while the 3-mode approach yields weaker dust absorptivity. Overall, on quasi-global average, the three size parameterizations result in a significant difference of a factor of 2~3 in dust surface cooling (-1.02~-2.87 W m-2) and atmospheric warming (0.39~0.96 W m-2) and in a tremendous difference of a factor of ~10 in dust TOA cooling (-0.24~-2.20 W m-2). An uncertainty of a factor of 2 is quantified in dust emission estimation due to the different size parameterizations. This study also highlights the uncertainties in modeling dust mass and number loading, deposition fluxes, and radiative forcing resulting from different size parameterizations, and motivates further investigation of the impact of size parameterizations on modeling dust impacts on air quality, climate, and ecosystem.

balance↗

Error and Uncertainty Quantification in the Numerical Simulation of Complex Fluid Flows

The failure of numerical simulation to predict physical reality is often a direct consequence of the compounding effects of numerical error arising from finite-dimensional approximation and physical model uncertainty resulting from inexact knowledge and/or statistical representation. In this topical lecture, we briefly review systematic theories for quantifying numerical errors and restricted forms of model uncertainty occurring in simulations of fluid flow. A goal of this lecture is to elucidate both positive and negative aspects of applying these theories to practical fluid flow problems. Finite-element and finite-volume calculations of subsonic and hypersonic fluid flow are presented to contrast the differing roles of numerical error and model uncertainty. for these problems.

Barth, Timothy J.↗

Predicting High Energy Arcing Fault Zones of Influence for Aluminum Using an Arc Flash Modeling Approach: Evaluation of a model bias, uncertainty, parameter sensitivity and zone of influence estimation

This report documents the development of an arc flash hazard model to calculate the incident energy and zone of influence from high energy arcing faults involving aluminum. The NRC has identified the potential for (HEAFs) involving aluminum to increase the damage zone beyond what is currently postulated in fire probabilistic risk assessment (PRA) methodologies. To estimate the hazard from HEAFs involving aluminum an arc flash model was developed. Differences between the initial model and nuclear power plant (NPP) fire PRA scenarios were identified. Modification of the initial model established from existing literature and test data was used to minimize these differences. The developed model was evaluated against NRC datasets to understand the model prediction and relative uncertainties. Finally, a range of fire PRA zone of influences (ZOI) were developed based on the developed model, target fragility estimates and update HEAF PRA methodology. The results were developed to support an NRC LIC-504 evaluation in tandem with other modeling efforts. The report documents the effort and provides a reference for any future advancements in arc flash modeling.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Neutrino Interaction Model and Uncertainties for MicroBooNE Analyses

The MicroBooNE experiment is searching for an excess of electron-like events at low neutrino energy, as well as making the first high-statistics measurements of neutrino interactions on argon. Interpretation of these results requires a reliable model of neutrino interaction physics with well-motivated uncertainties. This note describes the neutrino interaction model and uncertainties adopted for use in MicroBooNE’s cross section measurements and low-energy excess search.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An overview of methods to identify and manage uncertainty for modelling problems in the water-environment-agriculture cross-sector

Uncertainty pervades the representation of systems in the water–environment–agriculture cross-sector. Successful methods to address uncertainties have largely focused on standard mathematical formulations of biophysical processes in a single sector, such as partial or ordinary differential equations. More attention to integrated models of such systems is warranted. Model components representing the different sectors of an integrated model can have less standard, and different, formulations to one another, as well as different levels of epistemic knowledge and data informativeness. Thus, uncertainty is not only pervasive but also crosses boundaries and propagates between system components. Uncertainty assessment (UA) cries out for more eclectic treatment in these circumstances, some of it being more qualitative and empirical. Here in this paper, we discuss the various sources of uncertainty in such a cross-sectoral setting and ways to assess and manage them. We have outlined a fast-growing set of methodologies, particularly in the computational mathematics literature on uncertainty quantification (UQ), that seem highly pertinent for uncertainty assessment. There appears to be considerable scope for advancing UA by integrating relevant UQ techniques into cross-sectoral problem applications. Of course this will entail considerable collaboration between domain specialists who often take first ownership of the problem and computational methods experts.

97 MATHEMATICS AND COMPUTING↗

Predictive Modeling and Uncertainty Quantification in Condition Monitoring of Active Components: A Reactor Coolant Pump Use Case

This work develops data-driven models for onset of thermal barrier leakage in reactor coolant pumps. It incorporates uncertainty quantification to enhance the reliability and robustness of pre- dictions. Using synthetic data generated by the Generic Pressurized Water Reactor simulator, realistic degradation scenarios were simulated across lifecycle stages—beginning, middle, and end of life. Key variables, including differential pressure, flow rate, vibration, and temperatures, were analyzed using machine learning framework. The fully connected neural network models demonstrated exceptional performance, achieving R2 scores exceeding 0.99 and root mean square errors as low as around 8.23 × 10-2 gallon per minute (gpm) for the three stages of the lifecy- cle. UQ analysis further validated the model’s robustness, with narrow uncertainty bounds during steady-state operations and appropriately wider bounds during transitional phases, reflecting the physical behavior of the system. This work addresses important gaps in real-time condition moni- toring and regulatory compliance by integrating advanced condition monitoring technologies with UQ into IST programs. The ability to detect thermal barrier leakage early and quantify prediction reliability supports optimizing maintenance strategies while ensuring nuclear power plants’ safe and reliable operation.

99 - GENERAL AND MISCELLANEOUS↗

Experimental Robust Control of Structural Acoustic Radiation

This work addresses the design and application of robust controllers for structural acoustic control. Both simulation and experimental results are presented. H(infinity) and mu-synthesis design methods were used to design feedback controllers which minimize power radiated from a panel while avoiding instability due to unmodeled dynamics. Specifically, high order structural modes which couple strongly to the actuator-sensor path were poorly modeled. This model error was analytically bounded with an uncertainty model, which allowed controllers to be designed without artificial limits on control effort. It is found that robust control methods provide the control designer with physically meaningful parameters with which to tune control designs and can be very useful in determining limits of performance. Experimental results also showed, however, poor robustness properties for control designs with ad-hoc uncertainty models. The importance of quantifying and bounding model errors is discussed.

Cox, David E.↗

HZETRN Radiation Transport Validation Using Balloon-Based Experimental Data

The deterministic radiation transport code HZETRN (High charge (Z) and Energy TRaNsport) was developed by NASA to study the effects of cosmic radiation on astronauts and instrumentation shielded by various materials. This work presents an analysis of computed differential flux from HZETRN compared with measurement data from three balloon-based experiments over a range of atmospheric depths, particle types, and energies. Model uncertainties were quantified using an interval-based validation metric that takes into account measurement uncertainty both in the flux and the energy at which it was measured. Average uncertainty metrics were computed for the entire dataset as well as subsets of the measurements (by experiment, particle type, energy, etc.) to reveal any specific trends of systematic over- or under-prediction by HZETRN. The distribution of individual model uncertainties was also investigated to study the range and dispersion of errors beyond just single scalar and interval metrics. The differential fluxes from HZETRN were generally well-correlated with balloon-based measurements; the median relative model difference across the entire dataset was determined to be 30%. The distribution of model uncertainties, however, revealed that the range of errors was relatively broad, with approximately 30% of the uncertainties exceeding ± 40%. The distribution also indicated that HZETRN systematically under-predicts the measurement dataset as a whole, with approximately 80% of the relative uncertainties having negative values. Instances of systematic bias for subsets of the data were also observed, including a significant underestimation of alpha particles and protons for energies below 2.5 GeV/u. Muons were found to be systematically over-predicted at atmospheric depths deeper than 50 g/cm(sup 2) but under-predicted for shallower depths. Furthermore, a systematic under-prediction of alpha particles and protons was observed below the geomagnetic cutoff, suggesting that improvements to the light ion production cross sections in HZETRN should be investigated.

James E Warner↗

Reduced Uncertainties in the Flutter Analysis of the Aerostructures Test Wing

Tuning the finite element model using measured data to minimize the model uncertainties is a challenging task in the area of structural dynamics. A test validated finite element model can provide a reliable flutter analysis to define the flutter placard speed to which the aircraft can be flown prior to flight flutter testing. Minimizing the difference between numerical and experimental results is a type of optimization problem. Through the use of the National Aeronautics and Space Administration Dryden Flight Research Center s (Edwards, California, USA) multidisciplinary design, analysis, and optimization tool to optimize the objective function and constraints; the mass properties, the natural frequencies, and the mode shapes are matched to the target data and the mass matrix orthogonality is retained. The approach in this study has been applied to minimize the model uncertainties for the structural dynamic model of the aerostructures test wing, which was designed, built, and tested at the National Aeronautics and Space Administration Dryden Flight Research Center. A 25-percent change in flutter speed has been shown after reducing the uncertainties

Pak, Chan-gi↗

Reduced Uncertainties in the Flutter Analysis of the Aerostructures Test Wing

Tuning the finite element model using measured data to minimize the model uncertainties is a challenging task in the area of structural dynamics. A test validated finite element model can provide a reliable flutter analysis to define the flutter placard speed to which the aircraft can be flown prior to flight flutter testing. Minimizing the difference between numerical and experimental results is a type of optimization problem. Through the use of the National Aeronautics and Space Administration Dryden Flight Research Center's (Edwards, California) multidisciplinary design, analysis, and optimization tool to optimize the objective function and constraints; the mass properties, the natural frequencies, and the mode shapes are matched to the target data, and the mass matrix orthogonality is retained. The approach in this study has been applied to minimize the model uncertainties for the structural dynamic model of the aerostructures test wing, which was designed, built, and tested at the National Aeronautics and Space Administration Dryden Flight Research Center. A 25 percent change in flutter speed has been shown after reducing the uncertainties.

Pak, Chan-Gi↗

Space-Time Reduced-Order Modeling for Uncertainty Quantification

This work focuses on the space-time reduced-order modeling (ROM) method for solving large-scale uncertainty quantification (UQ) problems with multiple random coefficients. In contrast with the traditional space ROM approach, which performs dimension reduction in the spatial dimension, the space-time ROM approach performs dimension reduction on both the spatial and temporal domains, and thus enables accurate approximate solutions at a low cost. We incorporate the space-time ROM strategy with various classical stochastic UQ propagation methods such as stochastic Galerkin and Monte Carlo. Numerical results demonstrate that our methodology has significant computational advantages compared to state-of-the-art ROM approaches. By testing the approximation errors, we show that there is no obvious loss of simulation accuracy for space-time ROM given its high computational efficiency.

97 MATHEMATICS AND COMPUTING↗