Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Satellite characterization of global stratospheric sulfate aerosols released by Tonga volcano

Large volcanic eruptions create an enhanced layer of sulfate aerosols in the stratosphere. These sulfuric acid droplets persist for many months, altering the climate and stratospheric chemistry. Sulfate aerosols scatter sunlight back to space, cooling the surface of the Earth and absorb outgoing thermal radiation, heating the stratosphere. The calculation of the climate impact of sulfate aerosols depends on their physical properties such as droplet size and chemical composition. These properties are not well known, and this uncertainty contributes to the errors in climate model predictions. Here we derive the first empirical formula that predicts the composition of stratospheric sulfate aerosols from volcanic eruptions from the air temperature and water vapor pressure. Measurements of atmospheric infrared transmittance of the Hunga Tonga-Hunga Ha'apai sulfate aerosol plume by the Atmospheric Chemistry Experiment (ACE) satellite were analyzed to determine composition (weight percent of sulfuric acid) and median particle radius. These data are supplemented by measurements of the Raikoke and Nabro eruptions. Our analysis allows the properties of volcanic aerosols in the stratosphere to be predicted reliably in atmospheric models.

P Bernath↗

Optimizing near real time accountability for reprocessing.

Near Real Time Accountability (NRTA) of actinides at high precision in reprocessing plants has been a long sought-after goal in the safeguards community. Achieving this goal is hampered by the difficulty of making precision measurements in the reprocessing environment, equipment cost, and impact to plant operations. Thus the design of future reprocessing plants requires an optimization of different approaches. The Separations and Safeguards Performance Model, developed at Sandia National Laboratories, was used to evaluate a number of NRTA strategies in a UREX+ reprocessing plant. Strategies examined include the incorporation of additional actinide measurements of internal plant vessels, more use of process monitoring data, and the option of periodic draining of inventory to key tanks. Preliminary results show that the addition of measurement technologies can increase the overall measurement uncertainty due to additional error propagation, so care must be taken when designing an advanced system. Initial results also show that relying on a combination of different NRTA techniques will likely be the best option. The model provides a platform for integrating all the data. The modeling results for the different NRTA options under various material loss conditions will be presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Comparison of XSUSA and "Two-Step" Approaches for Full Core Uncertainty Quantification

While there are multiple sources of error that are introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily for quantifying the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the 'Two-Step' method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the Two-Step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution will be examined in the framework of phase I-3 of the UAM Benchmark. Using the TMI core as a base model for analysis, the XSUSA and Two-Step methods are applied with certain limitations and the results are compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions are made for which method is currently a more viable option for computing uncertainties in burnup and transient calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comprehensive ecosystem model-experiment synthesis using multiple datasets at two temperate forest free-air CO2 enrichment experiments: model performance and compensating biases

Free Air CO2 Enrichment (FACE) experiments provide a remarkable wealth of data to test the sensitivities of terrestrial ecosystem models (TEMs). In this study, a broad set of 11 TEMs were compared to 22 years of data from two contrasting FACE experiments in temperate forests of the south eastern US the evergreen Duke Forest and the deciduous Oak Ridge forest. We evaluated the models' ability to reproduce observed net primary productivity (NPP), transpiration and Leaf Area index (LAI) in ambient CO2 treatments. Encouragingly, many models simulated annual NPP and transpiration within observed uncertainty. Daily transpiration model errors were often related to errors in leaf area phenology and peak LAI. Our analysis demonstrates that the simulation of LAI often drives the simulation of transpiration and hence there is a need to adopt the most appropriate of hypothesis driven methods to simulate and predict LAI. Of the three competing hypotheses determining peak LAI (1) optimisation to maximise carbon export, (2) increasing SLA with canopy depth and (3) the pipe model the pipe model produced LAI closest to the observations. Modelled phenology was either prescribed or based on broader empirical calibrations to climate. In some cases, simulation accuracy was achieved through compensating biases in component variables. For example, NPP accuracy was sometimes achieved with counter-balancing biases in nitrogen use efficiency and nitrogen uptake. Combined analysis of parallel measurements aides the identification of offsetting biases; without which over-confidence in model abilities to predict ecosystem function may emerge, potentially leading to erroneous predictions of change under future climates.

Walker, Anthony P↗

Decay Constants $f_B$ and $f_{B_s}$ from HISQ Simulations

We give a progress report on a project aimed at a high-precision calculation of the decay constants $f_B$ and $f_{B_s}$ from simulations with HISQ heavy and light valence and sea quarks. Calculations are carried out with several heavy valence-quark masses on ensembles with 2+1+1 flavors of HISQ sea quarks at five lattice spacings and several light sea-quark mass ratios $m_{ud}/m_s$, including approximately physical sea-quark masses. This range of parameters provides excellent control of the continuum limit and of heavy-quark discretization errors. We present a preliminary error budget with projected uncertainties of 2.2~MeV and 1.5~MeV for $f_B$ and $f_{B_s}$, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Comparison of XSUSA and 'two-step' approaches for full-core uncertainty quantification

While there are multiple sources of error that are introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily for quantifying the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the 'Two-Step' method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the Two-Step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution will be examined in the framework of phase 1-3 of the UAM Benchmark. Using the TMI core as a base model for analysis, the XSUSA and Two-Step methods are applied with certain limitations and the results are compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions are made for which method is currently a more viable option for computing uncertainties in burnup and transient calculations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

On the Ill-Posed Nature of Inverse Problems: An Exactly Solvable Paradigm Inverse Neutron Diffusion Problem Illustrating the Solution's Non-Computability - Paper 48

In general, a physical system and/or the result of an indirect experimental measurement are modeled mathematically in terms of: (a) A system of linear and/or nonlinear equations that relate the system's independent variables and parameters to the system's state (i.e., dependent) variables; (b) Probability distributions, moments thereof, inequality and/or equality constraints that define the range of variations of the system's parameters; (c) One or several quantities, customarily referred to as system responses (or objective functions, or indices of performance), which are computed using the mathematical model. The 'direct problem' solves the 'parameter-to-output' mapping that describes the 'cause-to-effect' relationship in the respective physical process. In practice, the model parameters and/or responses are experimentally measured quantities and are therefore subject to uncertainties. Many measurement problems are 'inverse' to the direct problem in that they seek to determine the properties of the medium (i.e., various cross sections), or the properties of the source, and/or the size of the medium on its boundaries from measurements of quantities that depend on the neutron flux (or from direct measurements of the neutron flux). In general, two problems are called inverses of one another if the formulation of each involves all or part of the solution of the other. Some authors further group such inverse problems into 'invasive', when the interior flux is accessible for measurements as opposed to 'non-invasive', in which only fluxes on the boundary of (or exterior to) the medium can be measured. Examples of inverse radiative transfer problems have been reviewed by McCormick, while examples of inverse source problems for neutron transport have been provided by Sanchez and McCormick. More recently, Bledsoe et al., have presented two methods (the Levenberg-Marquard, and 'differential evolution method') for addressing numerically inverse transport problems. However, although these works (as well as other works cited therein) mentioned the detrimental effects of 'small perturbations in the input data', none of the works published thus far on inverse problems for particle transport or diffusion actually showed explicitly the effects that uncertainties in the measured responses (e.g., detector measurements) would actually have on the 'inverse' deduction (from such measurements) of the underlying medium's properties, sources, etc. This work highlights explicitly the nature of the difficulties encountered in so-called 'inverse problems' by presenting a paradigm inverse neutron diffusion problem admitting an exact solution, in which the 'inverse problem' is to determine the medium's diffusion coefficient from flux measurements. It will be shown explicitly (analytically) that this is not possible to achieve in a unique manner, even in the absence of measurement uncertainties, unless additional error-free information is provided about the quantity to be determined (in this case, the medium's diffusion coefficient). It if further shown that, even if this additional error-free information about the diffusion coefficient to be determined is available, the unavoidable experimental measurements errors, albeit it vanishingly small, in the measured flux render the 'exact solution' useless for computational purposes, since the exact solution turns out to be a divergent series. As discussed in this paper's ENDNOTES section, the paradigm problem presented in this work also underscores the need for 'regularization', which is a qualifier indicating that the inverse problem is to be solved in some approximate manner. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy,is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters, within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors' contributions to predictive uncertainty. As a result, the framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem

97 MATHEMATICS AND COMPUTING↗

Simulating wind power forecast error distributions for spatially aggregated wind power plants

Dispersion and aggregation of wind power plants lower the uncertainty of wind power by reducing wind power forecasting errors. Using quantitative methods, this paper studies the dispersion's impact on the uncertainty of the aggregated wind power production. A method to simulate day-ahead forecast error distributions at different dispersion and forecasting skill scenarios is presented. The proposed method models the uncertainty of wind power forecasting on an annual basis and at different levels of production. As a result, the uncertainty in the forecasting of spatially dispersed wind power plants is modelled using two continuous distributions: Laplace and beta distribution. The analysis shows that even the production level uncertainty can be modelled in various dispersion and forecasting skill scenarios. The model for aggregated forecast error distributions requires only four variables: capacity-weighted distance of the total wind power plant fleet, mean of the site-specific mean absolute errors (MAEs), number of aggregated wind power plants, and the mean variability of the elevations from the proximities of the aggregated wind power plants. Here, the results are especially promising when the number of aggregated wind power plants exceeds five, the terrain complexity is low or moderate, and the aggregation region is large. This is demonstrated through a case study for Texas, United States.

17 WIND ENERGY↗

Decision Science for Machine Learning (DeSciML)

The increasing use of machine learning (ML) models to support high-consequence decision making drives a need to increase the rigor of ML-based decision making. Critical problems ranging from climate change to nonproliferation monitoring rely on machine learning for aspects of their analyses. Likewise, future technologies, such as incorporation of data-driven methods into the stockpile surveillance and predictive failure analysis for weapons components, will all rely on decision-making that incorporates the output of machine learning models. In this project, our main focus was the development of decision scientific methods that combine uncertainty estimates for machine learning predictions, with a domain-specific model of error costs. Other focus areas include uncertainty measurement in ML predictions, designing decision rules using multiobjecive optimization, the value of uncertainty reduction, and decision-tailored uncertainty quantification for probability estimates. By laying foundations for rigorous decision making based on the predictions of machine learning models, these approaches are directly relevant to every national security mission that applies, or will apply, machine learning to data, most of which entail some decision context.

97 MATHEMATICS AND COMPUTING↗

Executive summary of error sources in dynamic surface temperature measurements

Obtaining bulk T requires measuring apparent sample interface T surface , knowledge of any window conditions T window , and knowledge of thermal transport from the sample to the window. To obtain bulk T with uncertainties below 5% requires relatively small uncertainties in each of these areas, and large uncertainties in one area require smaller uncertainties in others to maintain the error budget. For example, if T window is known to 10%, a 5% total uncertainty can be obtained if T surface is known to 1% and combined transport uncertainties are known to 20%. If T surface can only be measured to 2%, combined transport uncertainties must be 17% to reach the same overall uncertainty. As the form of transport is unknown at high pressure, and window temperatures are difficult to measure by their very nature, reducing surface T uncertainties is the practical first step. Here we will discuss various error sources in the measurement of apparent T surface , and which ones must be correctly obtained prior to the experiment.

36 MATERIALS SCIENCE↗

Errors in particle tracking velocimetry with high-speed cameras

Velocity errors in particle tracking velocimetry (PTV) are studied. When using high-speed video cameras, the velocity error may increase at a high camera frame rate. This increase in velocity error is due to particle-position uncertainty, which is one of the two sources of velocity errors studied here. The other source of error is particle acceleration, which has the opposite trend of diminishing at higher frame rates. Both kinds of errors can propagate into quantities calculated from velocity, such as the kinetic temperature of particles or correlation functions. As demonstrated in a dusty plasma experiment, the kinetic temperature of particles has no unique value when measured using PTV, but depends on the sampling time interval or frame rate. It is also shown that an artifact appears in an autocorrelation function computed from particle positions and velocities, and it becomes more severe when a small sampling-time interval is used. Schemes to reduce these errors are demonstrated.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Measurements of Effective Optical Depth in the Lyα Forest from the BOSS DR12 Quasar Sample

We measure the effective optical depth in the Lyα forest using 40,035 quasar spectra from the Twelfth Data Release (DR12) of the Baryon Oscillation Spectroscopic Survey of Sloan Digital Sky Survey IV. A rigorous selection based on spectral index and the equivalent width of the C iv emission line is applied to choose seven uniform samples with minimal intrinsic variations across redshifts. Modeling the redshift evolution of the effective optical depth with a power law, ${\tau }_{\mathrm{eff}}={\tau }_{0}{(1+z)}^{\gamma },$ produces ${\tau }_{0}=(5.54\pm 0.64)\times {10}^{-3}$ and $\gamma =3.182\pm 0.074$. The 2.2% precision estimate on γ is dominated by systematic errors, likely arising from the bias and uncertainties in spectral index estimates. Even after incorporating the systematic errors, this work provides the most precise estimates of optical depth parameters to date. Finally, using the reconstructed Lyα forest continuum to directly measure the transmitted flux ratio as a function of redshift, we find deviations of less than 2.5% from the predictions from the global model and no convincing evidence for signal associated with He ii reionization.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

Statistical aspects of carbon fiber risk assessment modeling

The probabilistic and statistical aspects of the carbon fiber risk assessment modeling of fire accidents involving commercial aircraft are examined. Three major sources of uncertainty in the modeling effort are identified. These are: (1) imprecise knowledge in establishing the model; (2) parameter estimation; and (3)Monte Carlo sampling error. All three sources of uncertainty are treated and statistical procedures are utilized and/or developed to control them wherever possible.

Gross, D.↗

Validation and Uncertainty Analysis of Stereo Time-Resolved PIV Measurements for Boundary-Layer Transition Research

An uncertainty analysis was performed on the stereo time-resolved particle image velocimetry measurements that were obtained in the boundary-layer of a swept wing model. Several different approaches were undertaken to estimate the uncertainty of the PIV measurements and to understand how that uncertainty propagates through to the results of interest. It was found that the stereo registration error, which is often neglected in stereo- PIV uncertainty analysis, can cause significant errors in the measured amplitude of the stationary cross ow instability due to the large spanwise velocity gradients that occur in the ow. The self-calibrations do not always adequately correct for the stereo-registration error. A simple approach is demonstrated for estimating the error due to a misalignment of the calibration target and laser plane. This approach was found to be very successful at predicting the error in stationary cross ow amplitude caused by the misalignment. The time-resolved PIV results are also compared to previously-acquired hotwire data. The TRPIV technique is successful at measuring the same types of unsteady instabilities as the hotwire, and thus does not appear to have any adverse e ect on the transition process due to the introduction of particles into the ow. It was also found that a larger interrogation window size is beneficial for reducing the noise of the TRPIV results.

Eppink, Jenna L.↗

Neural network uncertainty assessment using Bayesian statistics: a remote sensing application

Neural network (NN) techniques have proved successful for many regression problems, in particular for remote sensing; however, uncertainty estimates are rarely provided. In this article, a Bayesian technique to evaluate uncertainties of the NN parameters (i.e., synaptic weights) is first presented. In contrast to more traditional approaches based on point estimation of the NN weights, we assess uncertainties on such estimates to monitor the robustness of the NN model. These theoretical developments are illustrated by applying them to the problem of retrieving surface skin temperature, microwave surface emissivities, and integrated water vapor content from a combined analysis of satellite microwave and infrared observations over land. The weight uncertainty estimates are then used to compute analytically the uncertainties in the network outputs (i.e., error bars and correlation structure of these errors). Such quantities are very important for evaluating any application of an NN model. The uncertainties on the NN Jacobians are then considered in the third part of this article. Used for regression fitting, NN models can be used effectively to represent highly nonlinear, multivariate functions. In this situation, most emphasis is put on estimating the output errors, but almost no attention has been given to errors associated with the internal structure of the regression model. The complex structure of dependency inside the NN is the essence of the model, and assessing its quality, coherency, and physical character makes all the difference between a blackbox model with small output errors and a reliable, robust, and physically coherent model. Such dependency structures are described to the first order by the NN Jacobians: they indicate the sensitivity of one output with respect to the inputs of the model for given input data. We use a Monte Carlo integration procedure to estimate the robustness of the NN Jacobians. A regularization strategy based on principal component analysis is proposed to suppress the multicollinearities in order to make these Jacobians robust and physically meaningful.

Neural Networks (Computer)↗