Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Robustness analysis for real parametric uncertainty

Some key results in the literature in the area of robustness analysis for linear feedback systems with structured model uncertainty are reviewed. Some new results are given. Model uncertainty is described as a combination of real uncertain parameters and norm bounded unmodeled dynamics. Here the focus is on the case of parametric uncertainty. An elementary and unified derivation of the celebrated theorem of Kharitonov and the Edge Theorem is presented. Next, an algorithmic approach for robustness analysis in the cases of multilinear and polynomic parametric uncertainty (i.e., the closed loop characteristic polynomial depends multilinearly and polynomially respectively on the parameters) is given. The latter cases are most important from practical considerations. Some novel modifications in this algorithm which result in a procedure of polynomial time behavior in the number of uncertain parameters is outlined. Finally, it is shown how the more general problem of robustness analysis for combined parametric and dynamic (i.e., unmodeled dynamics) uncertainty can be reduced to the case of polynomic parametric uncertainty, and thus be solved by means of the algorithm.

Sideris, Athanasios↗

Uncertainty quantification of a deep learning fuel property prediction model

Deep learning models are being widely used in the field of combustion. Given the black-box nature of typical neural network based models, uncertainty quantification (UQ) is critical to ensure the reliability of predictions as well as the training datasets, and for a principled quantification of noise and its various sources. Deep learning surrogate models for predicting properties of chemical compounds and mixtures have been recently shown to be promising for enabling data-driven fuel design and optimization, with the ultimate goal of improving efficiency and lowering emissions from combustion engines. In this study, UQ is performed for a multi-task deep learning model that simultaneously predicts the research octane number (RON), Motor Octane Number (MON), and Yield Sooting Index (YSI) of pure components and multicomponent blends. The deep learning model is comprised of three smaller networks: Extractor 1, Extractor 2, and Predictor, and a mixing operator. The molecular fingerprints of individual components are encoded via Extractor 1 and Extractor 2, the mixing operator generates fingerprints for mixtures/blends based on linear mixing operation, and the predictor maps the fingerprint to the target properties. Two different classes of UQ methods, Monte Carlo ensemble methods and Bayesian neural networks (BNNs), are employed for quantifying the epistemic uncertainty. Combinations of Bernoulli and Gaussian distributions with DropConnect and DropOut techniques are explored as ensemble methods. All the DropConnect, DropOut and Bayesian layers are applied to the predictor network. Aleatoric uncertainty is modeled by assuming that each data point has an independent uncertainty associated with it. The results of the UQ study are further analyzed to compare the performance of BNN and ensemble methods. Although this study is confined to UQ of fuel property prediction, the methodologies are applicable to other deep learning frameworks that are being widely used in the combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

Power system resilience through defender-attacker-defender models with uncertainty: an overview

Protecting and fortifying a power system to make it resilient is an important and hard problem to solve. The interaction between defenders and attackers, the availability of information and the complexity of power system require carefully selecting models and presenting the underlying assumptions. Trilevel defender-attacker-defender models have been developed to investigate the resilience of power systems. In this paper, we review trilevel models in power system application, with the aim of demonstrating the accessibility and applicability of these complex optimization formulations and discussing the underlying assumptions from these models. In particular, we highlight modeling choices, algorithmic details, and how operational and information uncertainty affects resilience versus the traditional complete-knowledge-based optimal solutions. We also describe other similar relevant models which lack such uncertainty and discuss insights on how to address operational, attacker, and defender related uncertainties in future research efforts.

multi-level optimization, defender-attacker-defend↗

Uncertainty Error Modeling for Non-Linear State Estimation With Unsynchronized SCADA and µPMU Measurements

Distribution systems of the future smart grid require enhancements to the reliability of distribution system state estimation (DSSE) in the face of low measurement redundancy, unsynchronized measurements, and dynamic load profiles. Micro phasor measurement units (µPMUs) facilitate co-synchronized measurements with high granularity, albeit at an often prohibitively expensive installation cost. Supervisory control and data acquisition (SCADA) measurements can supplement µPMU data, although they are received at a slower sampling rate. Further complicating matters is the uncertainty associated with load dynamics and unsynchronized measurements–not only are the SCADA and µPMU measurements not synchronized with each other, but the SCADA measurements themselves are received at different time intervals with respect to one another. This paper proposes a non-linear state estimation framework which models dynamic load uncertainty error by updating the variances of the unsynchronized measurements, leading to a time-varying system of weights in the weighted least squares state estimator. Case studies are performed on the 33-Bus Distribution System in MATPOWER, using Ornstein–Uhlenbeck stochastic processes to simulate dynamic load conditions.

Cooper, Austin↗

Constraints on the Optical Depth of Galaxy Groups and Clusters

Future data from galaxy redshift surveys, combined with high-resolutions maps of the cosmic microwave background, will enable measurements of the pairwise kinematic Sunyaev–Zel’dovich (kSZ) signal with unprecedented statistical significance. This signal probes the matter-velocity correlation function, scaled by the average optical depth (τ) of the galaxy groups and clusters in the sample, and is thus of fundamental importance for cosmology. However, in order to translate pairwise kSZ measurements into cosmological constraints, external constraints on τ are necessary. In this work, we present a new model for the intracluster medium, which takes into account star formation, feedback, non-thermal pressure, and gas cooling. Our semi-analytic model is computationally efficient and can reproduce results of recent hydrodynamical simulations of galaxy cluster formation. We calibrate the free parameters in the model using recent X-ray measurements of gas density profiles of clusters, and gas masses of groups and clusters. Our observationally calibrated model predicts the average τ{sub 500} (i.e., the integrated τ within a disk of size R {sub 500}) to better than 6% modeling uncertainty (at 95% confidence level). If the remaining uncertainties associated with other astrophysical uncertainties and X-ray selection effects can be better understood, our model for the optical depth should break the degeneracy between optical depth and cluster velocity in the analysis of future pairwise kSZ measurements and improve cosmological constraints with the combination of upcoming galaxy and CMB surveys, including the nature of dark energy, modified gravity, and neutrino mass.

79 ASTRONOMY AND ASTROPHYSICS↗

Mori-Zwanzig reduced models for uncertainty quantification

In many time-dependent problems of practical interest the parameters and/or initial conditions entering the equations describing the evolution of the various quantities exhibit uncertainty. One way to address the problem of how this uncertainty impacts the solution is to expand the solution using polynomial chaos expansions and obtain a system of differential equations for the evolution of the expansion coefficients. We present an application of the Mori-Zwanzig (MZ) formalism to the problem of constructing reduced models of such systems of differential equations. In particular, we construct reduced models for a subset of the polynomial chaos expansion coefficients that are needed for a full description of the uncertainty caused by uncertain parameters or initial conditions. Even though the MZ formalism is exact, its straightforward application to the problem of constructing reduced models for estimating uncertainty involves the computation of memory terms whose cost can become prohibitively expensive. For those cases, we present a Markovian reformulation of the MZ formalism which can lead to approximations that can alleviate some of the computational expense while retaining an accuracy advantage over reduced models that discard the memory altogether. Our results support the conclusion that successful reduced models need to include memory effects.

Mori-Zwanzig, Model Reduction, Uncertainty Quantif↗

Greenhouse Gas Source Attribution: Measurements Modeling and Uncertainty Quantification

In this project we have developed atmospheric measurement capabilities and a suite of atmospheric modeling and analysis tools that are well suited for verifying emissions of green- house gases (GHGs) on an urban-through-regional scale. We have for the first time applied the Community Multiscale Air Quality (CMAQ) model to simulate atmospheric CO 2 . This will allow for the examination of regional-scale transport and distribution of CO 2 along with air pollutants traditionally studied using CMAQ at relatively high spatial and temporal resolution with the goal of leveraging emissions verification efforts for both air quality and climate. We have developed a bias-enhanced Bayesian inference approach that can remedy the well-known problem of transport model errors in atmospheric CO 2 inversions. We have tested the approach using data and model outputs from the TransCom3 global CO 2 inversion comparison project. We have also performed two prototyping studies on inversion approaches in the generalized convection-diffusion context. One of these studies employed Polynomial Chaos Expansion to accelerate the evaluation of a regional transport model and enable efficient Markov Chain Monte Carlo sampling of the posterior for Bayesian inference. The other approach uses de- terministic inversion of a convection-diffusion-reaction system in the presence of uncertainty. These approaches should, in principle, be applicable to realistic atmospheric problems with moderate adaptation. We outline a regional greenhouse gas source inference system that integrates (1) two ap- proaches of atmospheric dispersion simulation and (2) a class of Bayesian inference and un- certainty quantification algorithms. We use two different and complementary approaches to simulate atmospheric dispersion. Specifically, we use a Eulerian chemical transport model CMAQ and a Lagrangian Particle Dispersion Model - FLEXPART-WRF. These two models share the same WRF assimilated meteorology fields, making it possible to perform a hybrid simulation, in which the Eulerian model (CMAQ) can be used to compute the initial condi- tion needed by the Lagrangian model, while the source-receptor relationships for a large state vector can be efficiently computed using the Lagrangian model in its backward mode. In ad- dition, CMAQ has a complete treatment of atmospheric chemistry of a suite of traditional air pollutants, many of which could help attribute GHGs from different sources. The inference of emissions sources using atmospheric observations is cast as a Bayesian model calibration problem, which is solved using a variety of Bayesian techniques, such as the bias-enhanced Bayesian inference algorithm, which accounts for the intrinsic model deficiency, Polynomial Chaos Expansion to accelerate model evaluation and Markov Chain Monte Carlo sampling, and Karhunen-Lo %60 eve (KL) Expansion to reduce the dimensionality of the state space. We have established an atmospheric measurement site in Livermore, CA and are collect- ing continuous measurements of CO 2 , CH 4 and other species that are typically co-emitted with these GHGs. Measurements of co-emitted species can assist in attributing the GHGs to different emissions sectors. Automatic calibrations using traceable standards are performed routinely for the gas-phase measurements. We are also collecting standard meteorological data at the Livermore site as well as planetary boundary height measurements using a ceilometer. The location of the measurement site is well suited to sample air transported between the San Francisco Bay area and the California Central Valley.

54 ENVIRONMENTAL SCIENCES↗

Predicting Ice Sheet and Climate Evolution at Extreme Scales

A main research objectives of PISCEES is the development of formal methods for quantifying uncertainties in ice sheet modeling. Uncertainties in simulating and projecting mass loss from the polar ice sheets arise primarily from initial conditions, surface and basal boundary conditions, and model parameters. In general terms, two main chains of uncertainty propagation may be identified: 1. inverse propagation of observation and/or prior onto posterior control variable uncertainties; 2. forward propagation of prior or posterior control variable uncertainties onto those of target output quantities of interest (e.g., climate indices or ice sheet mass loss). A related goal is the development of computationally efficient methods for producing initial conditions for an ice sheet that are close to available present-day observations and essentially free of artificial model drift, which is required in order to be useful for model projections (“initialization problem”). To be of maximum value, such optimal initial states should be accompanied by “useful” uncertainty estimates that account for the different sources of uncerainties, as well as the degree to which the optimum state is constrained by available observations. The PISCEES proposal outlined two approaches for quantifying uncertainties. The first targets the full exploration of the uncertainty in model projections with sampling-based methods and a workflow managed by DAKOTA (the main delivery vehicle for software developed under QUEST). This is feasible for low-dimensional problems, e.g., those with a handful of global parameters to be inferred. This approach can benefit from derivative/adjoint information, but it is not necessary, which is why it often referred to as “non-intrusive”. The second approach makes heavy use of derivative information from model adjoints to address quantifying uncertainty in high-dimensions (e.g., basal boundary conditions in ice sheet models). The use of local gradient, or Hessian information (i.e., second derivatives of the cost function), requires additional code development and implementation, and is thus often referred to as an “intrusive” approach. Within PISCEES, MIT has been tasked to develop methods for derivative-based UQ, the ”intrusive” approach discussed above. These methods rely on the availability of first (adjoint) and second (Hessian) derivative code, developed through intrusive methods such as algorithmic differentiation (AD). While representing a significant burden in terms of code development, derivative-baesd UQ is able to cope with very high-dimensional uncertainty spaces. That is, unlike sampling methods (all variations of Monte Carlo), calculational burden is independent of the dimension of the uncertainty space. This is a significant advantage for spatially distributed uncertainty fields, such as threedimensional initial conditions, three-dimensional parameter fields, or two-dimensional surface and basal boundary conditions. Importantly, uncertainty fields for ice sheet models generally fall into this category.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification given discontinuous climate model response and a limited number of model runs.

Uncertainty quantification in complex climate models is challenged by the sparsity of available climate model predictions due to the high computational cost of model runs. Another feature that prevents classical uncertainty analysis from being readily applicable is bifurcative behavior in climate model response with respect to certain input parameters. A typical example is the Atlantic Meridional Overturning Circulation. The predicted maximum overturning stream function exhibits discontinuity across a curve in the space of two uncertain parameters, namely climate sensitivity and CO2 forcing. We outline a methodology for uncertainty quantification given discontinuous model response and a limited number of model runs. Our approach is two-fold. First we detect the discontinuity with Bayesian inference, thus obtaining a probabilistic representation of the discontinuity curve shape and location for arbitrarily distributed input parameter values. Then, we construct spectral representations of uncertainty, using Polynomial Chaos (PC) expansions on either side of the discontinuity curve, leading to an averaged-PC representation of the forward model that allows efficient uncertainty quantification. The approach is enabled by a Rosenblatt transformation that maps each side of the discontinuity to regular domains where desirable orthogonality properties for the spectral bases hold. We obtain PC modes by either orthogonal projection or Bayesian inference, and argue for a hybrid approach that targets a balance between the accuracy provided by the orthogonal projection and the flexibility provided by the Bayesian inference - where the latter allows obtaining reasonable expansions without extra forward model runs. The model output, and its associated uncertainty at specific design points, are then computed by taking an ensemble average over PC expansions corresponding to possible realizations of the discontinuity curve. The methodology is tested on synthetic examples of discontinuous model data with adjustable sharpness and structure.

54 ENVIRONMENTAL SCIENCES↗

Methods for evaluating the predictive accuracy of structural dynamic models

Modeling uncertainty is defined in terms of the difference between predicted and measured eigenvalues and eigenvectors. Data compiled from 22 sets of analysis/test results was used to create statistical databases for large truss-type space structures and both pretest and posttest models of conventional satellite-type space structures. Modeling uncertainty is propagated through the model to produce intervals of uncertainty on frequency response functions, both amplitude and phase. This methodology was used successfully to evaluate the predictive accuracy of several structures, including the NASA CSI Evolutionary Structure tested at Langley Research Center. Test measurements for this structure were within + one-sigma intervals of predicted accuracy for the most part, demonstrating the validity of the methodology and computer code.

Hasselman, Timothy K.↗

Hydraulic Properties Data Package for the E-Area Soils, Cementitious Materials, and Waste Zones–Update

Hydraulic property estimates for the soils, cementitious materials, and waste zones associated with the E-Area low-level radioactive waste disposal units have been provided to support the Performance Assessments (PA) for the E-Area Low-Level Waste Facility (LLWF). Nominal or “best estimate” hydraulic property values for use in the deterministic modeling are provided along with representations of the hydraulic property value uncertainty for use in sensitivity and uncertainty modeling. The hydraulic properties provided for each of the E-Area materials include: porosity ( η ), dry bulk density ( ρ b ), particle density (ρ p ), saturated hydraulic conductivity ( K sat ), characteristic curves (suction head, saturation, and relative permeability), and effective diffusion coefficient ( D e ). A representation of the uncertainty associated with each property, except for the characteristic curves, is provided for each material, except for the E-Area waste zones. These nominal parameter values for each of the E-Area soils, cementitious materials, and waste zones, and, where indicated, parameter uncertainty representations, are based upon the following in order of priority: Site-specific field data, Site-specific laboratory data, Similarity to material with site-specific field or laboratory data, and Literature data. Additionally, a methodology to represent long-term concrete degradation is provided. Finally, because much of the nominal hydraulic property values and uncertainty representations for the E-Area soils, cementitious materials, and waste zones are based on similarity to other materials or literature data, a methodology to prioritize additional work to better define these values and representations is outlined. Prioritization should be based on the importance of the material and/or property to the results of deterministic, sensitivity, and uncertainty modeling. This prioritization should be established through a process of sensitivity modeling. This report supersedes the previous hydraulic properties data package. Revision 1 contains clarifications, updates and corrections to text, figures and tables in a number of places in the report along with some minor editing.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Global Sensitivity Analysis and Estimation of Model Error, Toward Uncertainty Quantification in Scramjet Computations

The development of scramjet engines is an important research area for advancing hypersonic and orbital flights. Progress toward optimal engine designs requires accurate flow simulations together with uncertainty quantification. However, performing uncertainty quantification for scramjet simulations is challenging due to the large number of uncertain parameters involved and the high computational cost of flow simulations. These difficulties are addressed in this paper by developing practical uncertainty quantification algorithms and computational methods, and deploying them in the current study to large-eddy simulations of a jet in crossflow inside a simplified HIFiRE Direct Connect Rig scramjet combustor. First, global sensitivity analysis is conducted to identify influential uncertain input parameters, which can help reduce the system’s stochastic dimension. Second, because models of different fidelity are used in the overall uncertainty quantification assessment, a framework for quantifying and propagating the uncertainty due to model error is presented. In conclusion, these methods are demonstrated on a nonreacting jet-in-crossflow test problem in a simplified scramjet geometry, with parameter space up to 24 dimensions, using static and dynamic treatments of the turbulence subgrid model, and with two-dimensional and three-dimensional geometries.

33 ADVANCED PROPULSION SYSTEMS↗

Magnetized Winds of M-type Stars and Star–Planet Magnetic Interactions: Uncertainties and Modeling Strategy

M-type stars are the most common stars in the Universe. They are ideal hosts for the search of exoplanets in the habitable zone (HZ), as their small size and low temperature make the HZ much closer-in than their solar twins. Harboring very deep convective layers, they also usually exhibit very intense magnetic fields. Understanding their environment, in particular their coronal and wind properties, is thus very important, as they might be very different from what is observed in the solar system. The mass-loss rate of M-type stars is poorly known observationally, and recent attempts to estimate it for some of them (e.g., TRAPPIST-1 and Proxima Centauri) can vary by an order of magnitude. In this work, we revisit the stellar wind properties of M dwarfs in the light of the latest estimates of $\dot{M}$ through Lyα absorption at the astropause and slingshot prominences. We outline a modeling strategy to estimate the mass-loss rate, radiative loss, and wind speed, with uncertainties, based on an Alfvén-wave-driven stellar wind model. We find that it is very likely that several TRAPPIST-1 planets lie within the Alfvén surface, which implies that these planets experience star–planet magnetic interactions (SPMIs). We also find that SPMIs between Proxima Cen b and its host star could be the reason for recently observed radio emissions.

M stars↗

Investigation of methodology for uncertainty quantification of model parameters

Quantifying the uncertainty contributors of best-estimate thermal hydraulic code is getting more and more attention in safety analysis of nuclear industry during recent decades. Yet for uncertainties of certain model parameters which may not be directly measured, the quantification process is usually subjective and inaccurate. This paper investigates the statistical methodologies in order to get the probability density function (pdf) of model parameters more objectively based on observed experimental responses. The simplification of mathematical model is described for the parameter estimation, and solutions based on Bayesian theorem and Maximum Likelihood Estimation (MLE) are classified and demonstrated for both deterministic approach and stochastic approach. As an application, the uncertainties of model parameters related to reflood phenomena implemented in RELAP5 code are quantified. It is indicated that the statistical method which is independent of best-estimate code is feasible and easy to apply. And through the check of uncertainty propagation, it demonstrates that the uncertainty bands can envelope most of the experiment measurement with advantage of accuracy. (authors)

42 ENGINEERING↗

Backshell Radiative Heating and Shock Layer Kinetic Measurement in NASA’s Electric Arc Shock Tube Facility

A methodology for creating incident shocks with similarity to the backshell radiative heating environment on planetary probes is presented. Two test series were carried out in the Electric Arc Shock Tube (EAST) at NASA Ames to quantify the backshell environment for planned and executed missions entering the atmospheres of Mars and Titan. The comparison of measured radiance in the shock tube to predicted post shock radiation levels is used to quantify the uncertainty in the model. This model uncertainty may then be related back to the flight condition to assess the error in the flight heating prediction. Tests for Mars entry show the shock tube measurements to be bracketed between two kinetic models by 2-7%. This suggests an 8% error in predicting the measured heating cannot be attributed to radiation. Comparisons to planned Titan entry suggest a substantial overprediction of the backshell radiation, which suggests opportunity for future refinement of radiative heating models.

radiation↗