Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Closed Form Solution for Minimum Norm Model-Validating Uncertainty

A methodology in which structured uncertainty models are directly constructed from measurement data for use in robust control design of multivariable systems is proposed. The formulation allows a general linear fractional transformation uncertainty structure connections with respect to a given nominal model. Existence conditions are given, and under mild assumptions, a closed-form expression for the smallest norm structured uncertainty that validates the model is given. The uncertainty bound computation is simple and is formulated for both open and closed loop systems.

Lim, Kyong Been↗

TPSAS-NF1676L-12725-DND

Uncertainty analysis and robust design - increase confidence and consistency in aerospace vehicle safety predictions by developing improved methods for quantifying and managing uncertainty. Quantifying: uncertainty modeling (model uncertainty based on experimental data, simulations and/or expert opinion) and uncertainty propagation (given uncertainty models of a system’s inputs, how to propagate them through system models, to efficiently evaluate the corresponding system’s outputs?). Managing: robust design (generate designs that robustly accommodate uncertainty) and uncertainty decomposition (identify uncertainties that contribute the most to performance degradation and determine the parameters that should (not) be modeled as uncertain).

Sean P Kenny↗

Geomagnetic Disturbance Uncertainty Quantification Modeling: An Electromagnetic Transient and Steady-State Simulation Based Approach

Geomagnetic disturbances have been shown to disrupt the operation of the bulk electrical system through low-frequency effects in the earth's magnetic field that in turn induce changing electrical fields on the earth's surface. As a result, geomagnetically induced currents flow in transmission lines, introducing the risk for widespread damage to high-voltage transformers and voltage collapse due to induced reactive power loss. In a previous paper, the authors showed how certain modeling assumptions can lead to results that are unacceptable in certain edge case scenarios. In this paper, the authors build on their previous results using modeling uncertainty quantification in order to compare the results from electromagnetic transient program modeling software, ATP, to the positive-sequence calculation software, PowerWorld.

Bretas, Arturo Suman↗

The Sim-SEQ Project: Comparison of Selected Flow Models for the S-3 Site

Sim-SEQ is an international initiative on model comparison for geologic carbon sequestration, with an objective to understand and, if possible, quantify model uncertainties. Model comparison efforts in Sim-SEQ are at present focusing on one specific field test site, hereafter referred to as the Sim-SEQ Study site (or S-3 site). Within Sim-SEQ, different modeling teams are developing conceptual models of CO2 injection at the S-3 site. In this paper, we select five flow models of the S-3 site and provide a qualitative comparison of their attributes and predictions. These models are based on five different simulators or modeling approaches: TOUGH2/EOS7C, STOMP-CO2e, MoReS, TOUGH2-MP/ECO2N, and VESA. In addition to model-to-model comparison, we perform a limited model-to-data comparison, and illustrate how model choices impact model predictions. We conclude the paper by making recommendations for model refinement that are likely to result in less uncertainty in model predictions.

Carbon sequestration↗

Uncertainty-informed selection of CMIP6 Earth System Model subsets for use in multisectoral and impact models

Earth system models (ESMs) and general circulation models (GCMs) are heavily used to provide inputs to sectoral impact and multisector dynamic models, which include representations of energy, water, land, economics, and their interactions. Therefore, representing the full range of model uncertainty, scenario uncertainty, and interannual variability that ensembles of these models capture is critical to the exploration of the future co-evolution of the integrated human–Earth system. The pre-eminent source of these ensembles has been the Coupled Model Intercomparison Project (CMIP). With more modeling centers participating in each new CMIP phase, the size of the model archive is rapidly increasing, which can be intractable for impact modelers to effectively utilize due to computational constraints and the challenges of analyzing large datasets. In this work, we present a method to select a subset of the latest phase, CMIP6, featuring models for use as inputs to a sectoral impact or multisector dynamics models, while prioritizing preservation of the range of model uncertainty, scenario uncertainty, and interannual variability in the full CMIP6 ensemble results. This method is intended to help impact modelers select climate information from the CMIP archive efficiently for use in downstream models that require global coverage of climate information. This is particularly critical for large-ensemble experiments of multisector dynamic models that may be varying additional features beyond climate inputs in a factorial design, thus putting constraints on the number of climate simulations that can be used. We focus on temperature and precipitation outputs of CMIP6 models, as these are two of the most used variables among impact models, and many other key input variables for impacts are at least correlated with one or both of temperature and precipitation (e.g., relative humidity). Besides preserving the multi-model ensemble variance characteristics, we prioritize selecting CMIP6 models in the subset that preserve the very likely distribution of equilibrium climate sensitivity values as assessed by the latest Intergovernmental Panel on Climate Change (IPCC) report. This approach could be applied to other output variables of climate models and, possibly when combined with emulators, offers a flexible framework for designing more efficient experiments on human-relevant climate impacts. It can also provide greater insight into the properties of existing CMIP6 models.

Snyder, Abigail C.↗

Analysis and reduction of chemical models under uncertainty.

While models of combustion processes have been successful in developing engines with improved fuel economy, more costly simulations are required to accurately model pollution chemistry. These simulations will also involve significant parametric uncertainties. Computational singular perturbation (CSP) and polynomial chaos-uncertainty quantification (PC-UQ) can be used to mitigate the additional computational cost of modeling combustion with uncertain parameters. PC-UQ was used to interrogate and analyze the Davis-Skodje model, where the deterministic parameter in the model was replaced with an uncertain parameter. In addition, PC-UQ was combined with CSP to explore how model reduction could be combined with uncertainty quantification to understand how reduced models are affected by parametric uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Model Form Uncertainty of Epidemic Forecasting Models from Incidence Data

Objective We present a mathematical framework for non-parametric estimation of the force of infection, together with statistical upper and lower confidence bands. The resulting estimates allow to assess how well simpler models, such as SEIR, fit the observed time series of incidence data.IntroductionUncertainty Quantification (UQ), the ability to quantify the impact of sample-to-sample variations and model misspecification on predictions and forecasts, is a critical aspect of disease surveillance. While quantifying the impact of stochastic uncertainty in the data is well understood, quantifying the impact of model misspecification is significantly harder. For the latter, one needs a "universal model" to which more restrictive parametric models are compared too.MethodsThis talk presents a useful modeling framework for time series of incidence data from contagious diseases that enables one to identify and quantify the impact of model form uncertainty. Specifically, we propose to focus on estimating the timedependent force of infection. The latter is a universal parameters for all contagious disease model. Using a machine learning technique for estimating monotone functions, i.e., isotonic regression and its variants, one can estimate the force ofinfection without addtional assumptions. We note that most contagious disease model do satisfy this monotonicity assumption, due to a combination of factors: depletion of susceptibles, implementation of mitigation strategies, behavior change, etc. Comparing the resulting "non-parametric" estimate with parametric estimates, obtained by fitting an SEIR for example, can reveal model deficiencies and help quantify model form uncertainties.Finally, we discuss how ideas from "strict bound theory" can be used to develop upper and lower uncertainty bands for force of infection that acknowledge the intrinsic stochasticity in the data.ResultsWe demonstrate the application of the methodology to weekly Influenza Like Illness (ILI) incidence data from France andcompare the results to fitted SIR and SEIR models. This comparison can be seen as a nonparametric goodness of fit test, providing one with tools to do simple model selection.ConclusionsWe present a novel and flexible model to statistically describe the force of infection as a function of time. Comparing the fit to incidence data of that model with the fit of simpler parametric models enables the quantification of model form uncertainty and associated model selection.

Hengartner, Nicholas↗

Microgravity isolation system design: A case study

Many acceleration-sensitive, microgravity science experiments will require active vibration isolation from manned orbiters on which they will be mounted. The isolation problem, especially in the case of a tethered payload, is a complex three-dimensional one that is best suited to modern-control design methods. In this paper, extended H(sub 2) synthesis is used to design an active isolator (i.e., controller) for a realistic single-input-multiple-output (SIMO) microgravity vibration isolation problem. Complex mu-analysis methods are used to analyze the isolation system with respect to sensor, actuator, and umbilical uncertainties. The paper fully discusses the design process employed and the insights gained. This design case study provides a practical approach for isolation problems of greater complexity. Issues addressed include a physically intuitive state-space description of the system, disturbance and noise filters, filters for frequency weighting, and uncertainty models. The controlled system satisfies all the performance specifications and is robust with respect to model uncertainties.

Hampton, R. D.↗

Visualizing 2D Probability Distributions from Satellite Image-Derived Data

Creating maps of biophysical and geophysical variables using Earth Observing System (EOS) satellite image data is an important component of Earth science. These 2D maps have a single value at every location and standard techniques are used to visualize them. Current tools fall short, however, when it is necessary to describe a distribution of values at each location. Distributions may represent a frequency of occurrence over time, frequency of occurrence from multiple runs of an ensemble forecast or possible values from an uncertainty model. 'Distribution data sets' are described, then a case study is presented to visualize such 2D distributions. Distribution data sets are different from multivariate data sets in the sense that the values are for a single variable instead of multiple variables. Our case study data consists of multiple realizations of percent forest cover, generated using a geostatistical technique that combines ground measurements and satellite imagery to model uncertainty about forest cover. We present several approaches for analyzing and visualizing such data sets. The first is a pixel-wise analysis of the probability density functions for the 2D image while the second is an analysis of features identified within the image. Such pixel-wise and feature-wise views will give Earth scientists a more complete understanding of distribution data sets.

Kao, David↗

Preliminary Model Comparison Results From the Sim-SEQ Project Using TOUGH2, STOMP, Eclipse, and VESA Approach

Sim-SEQ is an international initiative on model comparison for geologic carbon sequestration (GCS), with an objective to understand and, if possible, quantify model uncertainties. Model comparison efforts in Sim-SEQ are initially limited to one specific field test site, hereafter referred to as the Sim-SEQ Study site (or S-3 site). Within Sim-SEQ, different modeling teams are developing conceptual models of CO2 injection at the S-3 site. One of the conceptual models, developed by the LBNL team, is based on TOUGH2/EOS7C. In this paper, we present some preliminary model predictions of the S-3 site using the TOUGH2/EOS7C simulator. We also compare the predictions of the TOUGH2 simulator with three other conceptual models, developed by three different organizations, of the S-3 site.

carbon sequestration↗

Data & model conditioning for multivariate systematic uncertainty in model calibration, validation, and extrapolation.

This paper discusses implications and appropriate treatment of systematic uncertainty in experiments and modeling. Systematic uncertainty exists when experimental conditions, and/or measurement bias errors, and/or bias contributed by post-processing the data, are constant over the set of experiments but the particular values of the conditions and/or biases are unknown to within some specified uncertainty. Systematic uncertainties in experiments do not automatically show up in the output data, unlike random uncertainty which is revealed when multiple experiments are performed. Therefore, the output data must be properly 'conditioned' to reflect important sources of systematic uncertainty in the experiments. In industrial scale experiments the systematic uncertainty in experimental conditions (especially boundary conditions) is often large enough that the inference error on how the experimental system maps inputs to outputs is often quite substantial. Any such inference error and uncertainty thereof also has implications in model validation and calibration/conditioning; ignoring systematic uncertainty in experiments can lead to 'Type X' error in these procedures. Apart from any considerations of modeling and simulation, reporting of uncertainty associated with experimental results should include the effects of any significant systematic uncertainties in the experiments. This paper describes and illustrates the treatment of multivariate systematic uncertainties of interval and/or probabilistic natures, and combined cases. The paper also outlines a practical and versatile 'real-space' framework and methodology within which experimental and modeling uncertainties (correlated and uncorrelated, systematic and random, aleatory and epistemic) are treated to mitigate risk in model validation, calibration/conditioning, hierarchical modeling, and extrapolative prediction.

97 MATHEMATICS AND COMPUTING↗

NASA Engineering and Safety Center Technical Bulletin No. 22-04: Uncertainty Quantification of Reduced Order Structural Dynamic Models

Uncertainty quantification (UQ) provides statistical bounds on prediction accuracy based on finite element model (FEM) uncertainty. An alternate method for UQ, called the Hybrid Parametric Variation (HPV) combines a parametric variation of the Hurty/Craig-Bampton (HCB) fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method. This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available.

Uncertainty Quantification↗

Shock Layer Radiation Modeling and Uncertainty for Mars Entry

A model for simulating nonequilibrium radiation from Mars entry shock layers is presented. A new chemical kinetic rate model is developed that provides good agreement with recent EAST and X2 shock tube radiation measurements. This model includes a CO dissociation rate that is a factor of 13 larger than the rate used widely in previous models. Uncertainties in the proposed rates are assessed along with uncertainties in translational-vibrational relaxation modeling parameters. The stagnation point radiative flux uncertainty due to these flowfield modeling parameter uncertainties is computed to vary from 50 to 200% for a range of free-stream conditions, with densities ranging from 5e-5 to 5e-4 kg/m3 and velocities ranging from of 6.3 to 7.7 km/s. These conditions cover the range of anticipated peak radiative heating conditions for proposed hypersonic inflatable aerodynamic decelerators (HIADs). Modeling parameters for the radiative spectrum are compiled along with a non-Boltzmann rate model for the dominant radiating molecules, CO, CN, and C2. A method for treating non-local absorption in the non-Boltzmann model is developed, which is shown to result in up to a 50% increase in the radiative flux through absorption by the CO 4th Positive band. The sensitivity of the radiative flux to the radiation modeling parameters is presented and the uncertainty for each parameter is assessed. The stagnation point radiative flux uncertainty due to these radiation modeling parameter uncertainties is computed to vary from 18 to 167% for the considered range of free-stream conditions. The total radiative flux uncertainty is computed as the root sum square of the flowfield and radiation parametric uncertainties, which results in total uncertainties ranging from 50 to 260%. The main contributors to these significant uncertainties are the CO dissociation rate and the CO heavy-particle excitation rates. Applying the baseline flowfield and radiation models developed in this work, the radiative heating for the Mars Pathfinder probe is predicted to be nearly 20 W/cm2. In contrast to previous studies, this value is shown to be significant relative to the convective heating.

Johnston, Christopher O.↗

A robust Bayesian approach to modeling epistemic uncertainty in common-cause failure models

In a standard Bayesian approach to the alpha-factor model for common-cause failure, a precise Dirichlet prior distribution models epistemic uncertainty in the alpha-factors. This Dirichlet prior is then updated with observed data to obtain a posterior distribution, which forms the basis for further inferences. In this paper, we adapt the imprecise Dirichlet model of Walley to represent epistemic uncertainty in the alpha-factors. In this approach, epistemic uncertainty is expressed more cautiously via lower and upper expectations for each alpha-factor, along with a learning parameter which determines how quickly the model learns from observed data. For this application, we focus on elicitation of the learning parameter, and find that values in the range of 1 to 10 seem reasonable. The approach is compared with Kelly and Atwood's minimally informative Dirichlet prior for the alpha-factor model, which incorporated precise mean values for the alpha-factors, but which was otherwise quite diffuse. Next, we explore the use of a set of Gamma priors to model epistemic uncertainty in the marginal failure rate, expressed via a lower and upper expectation for this rate, again along with a learning parameter. As zero counts are generally less of an issue here, we find that the choice of this learning parameter is less crucial. Finally, we demonstrate how both epistemic uncertainty models can be combined to arrive at lower and upper expectations for all common-cause failure rates. Thereby, we effectively provide a full sensitivity analysis of common-cause failure rates, properly reflecting epistemic uncertainty of the analyst on all levels of the common-cause failure model.

99 GENERAL AND MISCELLANEOUS↗

What’s Driving Uncertainty? The Model or the Model Parameters (What’s Driving Uncertainty? The influences of model and model parameters in data analysis)

Here, one of the substantial improvements to the practice of data analysis in recent decades is the change from reporting just a point estimate for a parameter or characteristic, to now including a summary of uncertainty for that estimate. Understanding the precision of the estimate for the quantity of interest provides better understanding of what to expect and how well we are able to predict future behavior from the process. For example, when we report a sample average as an estimate of the population mean, it is good practice to also provide a confidence interval (or credible interval, if you are doing a Bayesian analysis) to accompany that summary. This helps to calibrate what ranges of values are reasonable given the variability observed in the sample and the amount of data that were included in producing the summary.

97 MATHEMATICS AND COMPUTING↗