Search NASA⌕ Search

SEARCH · Search NASA

Results for “Propagation of Variance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data

ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurement Error Variance Estimation in Gamma-Spectroscopy Data using FRAM

The FRAM gamma-ray isotopic analysis code has recently been applied to four Pu data sets and four U data sets, each with relatively well-characterized standard items, in order to estimate the variances of random errors and of item-specific systematic errors. Assay results are available for Pu238, Pu239, Pu240, Pu241, Pu242 (operator entered, not independently measured), Am241, Specific Power, and Pu240eff. For the four U data sets, results are available for the measurands U234, U235, U236 (operator entered, not independently measured), and U238. For example, in Pu data set 1, there are 33 standard reference Pu items, which have well-known nominal/true values (except for a few items). FRAM was used to make approximately 15 repeat measurements for each of the 33 items, so empirical standard deviations can be calculated. In addition, FRAM internally estimates its random error variance using propagation of variance. This paper applies analysis of variance (ANOVA) to separately estimate the repeatability standard deviation and the standard deviation of the item-specific biases δ s in each of the 8 data sets.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Count Every Trip: Finding the Uncertainty in Energy Estimates Made from Inferred Travel Modes

To properly inform transport policy and infrastructure changes, transportation related metrics need both measured values and uncertainties of those values. Travel monitoring smartphone apps can record people's travel behavior, but trip data quality is limited by sensor errors, user labeling rates and the accuracy of inference algorithms used for travel diary creation. We discuss the use of phone app recorded travel diary data to estimate energy consumption, and propose the use of propagation of variance to find error bars for such estimates. We define energy consumption for one trip as trip length times the energy intensity per distance unit of the travel mode used. We characterize trip length errors with relative error and inferred trip mode errors with confusion matrix columns. The resulting variances of each measurement are then propagated to the final calculated energy consumption. We tested our uncertainty methods on a dataset that used phone app data combined with prompted recall, consisting of 92,234 labeled trips for over 500,000 miles. Accounting for uncertainty using expected energy intensities and variance propagation gives a dataset-wide aggregate energy consumption percent error of about 9%, within one standard deviation from the truth. Future work could involve applying similar methods to other travel diary based metrics.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Count Every Trip: Finding the Uncertainty in Energy Estimates Made from Inferred Travel Modes

To properly inform transport policy and infrastructure changes, transportation related metrics need both measured values and uncertainties of those values. Travel monitoring smartphone apps can record people's travel behavior, but trip data quality is limited by sensor errors, user labeling rates and the accuracy of inference algorithms used for travel diary creation. We discuss the use of phone app recorded travel diary data to estimate energy consumption, and propose the use of propagation of variance to find error bars for such estimates. We define energy consumption for one trip as trip length times the energy intensity per distance unit of the travel mode used. We characterize trip length errors with relative error and inferred trip mode errors with confusion matrix columns. The resulting variances of each measurement are then propagated to the final calculated energy consumption. We tested our uncertainty methods on a dataset that used phone app data combined with prompted recall, consisting of 92,234 labeled trips for over 500,000 miles. Accounting for uncertainty using expected energy intensities and variance propagation gives a dataset-wide aggregate energy consumption percent error of about 9%, within one standard deviation from the truth. Future work could involve applying similar methods to other travel diary based metrics.

ADVANCED PROPULSION SYSTEMS↗

Estimating Travel Energy Consumption Uncertainty Based on Inferred Travel Mode and Sensed Travel Length

To properly inform transport policy and infrastructure changes, transportation related metrics need both measured values and uncertainties of those values. Travel monitoring smartphone apps can record people's travel behavior, but trip data quality is limited by sensor errors, user labeling rates and the accuracy of inference algorithms used for travel diary creation. We discuss the use of phone app recorded travel diary data to estimate energy consumption, and propose the use of propagation of variance to find error bars for such estimates. We define energy consumption for one trip as trip length times the energy intensity per distance unit of the travel mode used. We characterize trip length errors with relative error and inferred trip mode errors with confusion matrix columns. The resulting variances of each measurement are then propagated to the final calculated energy consumption. We tested our uncertainty methods on a dataset that used phone app data combined with prompted recall, consisting of 92,234 labeled trips for over 500,000 miles. Accounting for uncertainty using expected energy intensities and variance propagation gives a dataset-wide aggregate energy consumption percent error of about 8%, within one standard deviation from the truth. Future work could involve applying similar methods to other travel diary based metrics.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

Non-Destructive Assay (NDA) Uncertainties Impact on Physical Inventory Difference (ID) and Material Balance Determination: Sources of Error, Precision/Accuracy, and ID/Propagation of Error (POV)

These are slides from a presentation made by a researcher from Los Alamos National Laboratory. The following topics are covered: sources of error for NDA gamma measurements, precision and accuracy are two important characteristics of measurements, four items processed in a material balance area during the inventory time period, inventory difference and propagation of variance, sum in quadrature, and overview of the ID/POV process.

36 MATERIALS SCIENCE↗

Estimating the mass variance in neutron multiplicity counting $-$ A comparison of approaches

In the standard practice of neutron multiplicity counting, the first three sampled factorial moments of the event triggered neutron count distribution are used to quantify the three main neutron source terms: the spontaneous fissile material effective mass, the relative (α,n) production and the induced fission source responsible for multiplication. This study compares three methods to quantify the statistical uncertainty of the estimated mass: the bootstrap method, propagation of variance through moments, and statistical analysis of cycle data method. Each of the three methods was implemented on a set of four different NMC measurements, held at the JRC-laboratory in Ispra, Italy, sampling four different Pu samples in a standard Plutonium Scrap Multiplicity Counter (PSMC) well counter.

74 ATOMIC AND MOLECULAR PHYSICS↗

Data-optimized source modeling with the Backwards Liouville Test–Kinetic method

In the standard practice of neutron multiplicity counting , the first three sampled factorial moments of the event triggered neutron count distribution were used to quantify the three main neutron source terms: the spontaneous fissile material effective mass, the relative (α,n) production and the induced fission source responsible for multiplication. Our study compares three methods to quantify the statistical uncertainty of the estimated mass: the bootstrap method, propagation of variance through moments, and statistical analysis of cycle data method. Each of the three methods was implemented on a set of four different NMC measurements, held at the JRC-laboratory in Ispra, Italy, sampling four different Pu samples in a standard Plutonium Scrap Multiplicity Counter (PSMC) well counter.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayesian Inference applied to the Solubility of Phase-3 and Phase-5

This Section covers an introduction to the objectives and techniques used in this analysis. The objectives of the report are given in Subsection 1.1. An introduction to aqueous thermodynamics and how variance might propagate through the relevant thermodynamic equations is given in Subsection 1.2. An introduction to Bayesian inference and its application to thermodynamic modeling is given in Subsection 1.3.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhanced Performance Controller Design for Stochastic Systems by Adding Extra State Estimation onto the Existing Closed Loop Control

To enhance the performance of the tracking property , this paper presents a novel control algorithm for a class of linear dynamic stochastic systems with unmeasurable states, where the performance enhancement loop is established based on Kalman filter. Without changing the existing closed loop with the PI controller, the compensative controller is designed to minimize the variances of the tracking errors using the estimated states and the propagation of state variances. Moreover, the stability of the closed-loop systems has been analyzed in the mean-square sense. A simulated example is included to show the effectiveness of the presented control algorithm, where encouraging results have been obtained.

Stochastic coupling attenuation↗

Overview ID/POV Process

This is a flowchart of the inventory difference/propagation of variance process, with steps such as determine all relevance transactions, group relevant transactions by affected MATLID, filter groups to S, F and identify required M's, etc.

97 MATHEMATICS AND COMPUTING↗

Propagation of non-Gaussian voltage angle fluctuations in high-voltage power grids

Recent measurements have reported non-Gaussian tails in the distribution of frequency data in electric power grids. Large frequency deviations may induce grid instabilities and it is therefore crucial to understand how noise disturbances with long, non-Gaussian tails propagate. Here, we investigate how fluctuations in power feed-in, characterized by non-zero cumulants of their distribution, propagate through high-voltage power grids. Unlike previous investigations which focused on the white-noise limit, we consider the limit of long noise correlation time, where power feed-in fluctuates over times longer than the inherent dynamical time scales of the grid - the relevant regime for large-scale, high-voltage distribution grids. In this work, we show that in this limit, the skewness and kurtosis of the power feed-in distribution propagate similarly as its variance, independently of the distribution of inertia. Non-Gaussianities from individual sources of noise therefore persist throughout the entire network. This finding is corroborated by numerical results on a realistic model of the synchronous grid of continental Europe.

42 ENGINEERING↗

Driving mode analysis—How uncertain functional inputs propagate to an output

Abstract Driving mode analysis elucidates how correlated features of uncertain functional inputs jointly propagate to produce uncertainty in the output of a computation. Uncertain input functions are decomposed into three terms: the mean functions, a zero‐mean driving mode, and zero‐mean residual. The random driving mode varies along a single direction, having fixed functional shape and random scale. It is uncorrelated with the residual, and under linear error propagation, it produces an output variance equal to that of the full input uncertainty. Finally, the driving mode best represents how input uncertainties propagate to the output because it minimizes expected squared Mahalanobis distance amongst competitors. These characteristics recommend interpretation of the driving mode as the single‐degree‐of‐freedom component of input uncertainty that drives output uncertainty. We derive the functional driving mode, show its superiority to other seemingly sensible definitions, and demonstrate the utility of driving mode analysis in an application. The application is the simulation of neutron transport in criticality experiments. The uncertain input functions are nuclear data that describe how Pu reacts to bombardment by neutrons. Visualization of the driving mode helps scientists understand what aspects of correlated functional uncertainty have effects that either reinforce or cancel one another in propagating to the output of the simulation.

97 MATHEMATICS AND COMPUTING↗

Differences in Tropical Rainfall in Aquaplanet Simulations With Resolved or Parameterized Deep Convection

Abstract This study investigates the effects of resolved deep convection on tropical rainfall and its multi‐scale variability. A series of aquaplanet simulations are analyzed using the Model for Prediction Across Scales‐Atmosphere with horizontal cell spacings from 120 to 3 km. The 3‐km experiment uses a novel configuration with 3‐km cell spacing between 20°S and 20°N and 15‐km cell spacing poleward of 30°N/S. A comparison of those experiments shows that resolved deep convection yields a narrower, stronger, and more equatorward intertropical convergence zone, which is supported by stronger nonlinear horizontal momentum advection in the boundary layer. There is also twice as much tropical rainfall variance in the experiment with resolved deep convection than in the experiments with parameterized convection. All experiments show comparable precipitation variance associated with Kelvin waves; however, the experiment with resolved deep convection shows higher precipitation variance associated with westward propagating systems. Resolved deep convection also yields at least two orders of magnitude more frequent heavy rainfall rates (>2 mm hr −1 ) than the experiments with parameterized convection. A comparison of organized precipitation systems demonstrates that tropical convection organizes into linear systems that are associated with stronger and deeper cold pools and upgradient convective momentum fluxes when convection is resolved. In contrast, parameterized convection results in more circular systems, weaker cold pools, and downgradient convective momentum fluxes. These results suggest that simulations with parameterized convection are missing an important feedback loop between the mean state, convective organization, and meridional gradients of moisture and momentum.

Rios‐Berrios, Rosimar↗

Unbalanced Nested Random Effects Estimation of Variance Components

To investigate the contributing factors of variance in the measurement of an iodine 127 (127I) sample, we implement a nested random effects analysis of variance (ANOVA). Historically, the reported uncertainty on a measurement of 127I has been obtained by methods of forward uncertainty propagation because there is typically only one replicate of a given sample for which to estimate the uncertainty. When samples are processed there are several types of quality control (QC) standards analyzed along-side the unknown samples with two to five replicates for each. Assuming the variance observed in these replicate QC standards is representative of that of the unknown samples, we use these data in a nested random effects ANOVA to estimate the total uncertainty of a measurement. We demonstrate this approach with two sets of measurements from Idaho National Laboratory and compare the results with the forward uncertainty propagation approach. Variance component estimates for the coarsest level of the nesting structure were most imprecise because replicates were most limited at these levels. We find that the results largely agree between forward propagation and ANOVA, and the greatest contributors of variance are due to instrument variation and chemical processing, with human processing being among the smallest contributors. This analysis provides reassurance that the reported uncertainties using forward propagation are reasonable and the process is well controlled. We propose a future designed experiment to increase replicates at the coarsest level of the hierarchy to improve estimates of these variance components.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Ignoring correlation in uncertainty and sensitivity analysis in life cycle assessment: what is the risk?

Life cycle assessment (LCA) is an established tool to quantify the environmental impact of a product. A good assessment of uncertainty is important for making well-informed decisions in comparative LCA, as well as for correctly prioritising data collection efforts. Under- or overestimation of output uncertainty (e.g. output variance) will lead to incorrect decisions in such matters. The presence of correlations between input parameters during uncertainty propagation, can increase or decrease the the output variance. However, most LCA studies that include uncertainty analysis, ignore correlations between input parameters during uncertainty propagation, which may lead to incorrect conclusions. Two approaches to include correlations between input parameters during uncertainty propagation and global sensitivity analysis were studied: an analytical approach and a sampling approach. The use of both approaches is illustrated for an artificial case study of electricity production. Results demonstrate that both approaches yield approximately the same output variance and sensitivity indices for this specific case study. Furthermore, we demonstrate that the analytical approach can be used to quantify the risk of ignoring correlations between input parameters during uncertainty propagation in LCA. We demonstrate that: (1) we can predict if including correlations among input parameters in uncertainty propagation will increase or decrease output variance; (2) we can quantify the risk of ignoring correlations on the output variance and the global sensitivity indices. Moreover, this procedure requires only little data. - Highlights: • Ignoring correlation leads to under- or overestimation of the output variance. • We demonstrated that the risk of ignoring correlation can be quantified. • The procedure proposed is generally applicable in life cycle assessment. • In some cases, ignoring correlation has a minimal effect on decision-making tools.

54 ENVIRONMENTAL SCIENCES↗

An Open Combinatorial Diffraction Dataset Including Consensus Human and Machine Learning Labels with Quantified Uncertainty for Training New Machine Learning Models

Modern machine learning and autonomous experimentation schemes in materials science rely on accurate analysis of the data ingested by these models. Unfortunately, accurate analysis of the underlying data can be difficult, even for domain experts, complicating the training of the models intended to drive experiments. This is especially true when the goal is to identify the presence of weak signatures in diffraction or spectroscopic datasets. In this work, we examine a set of as-obtained diffraction data that track the phase transition from monoclinic to tetragonal in a Nb-doped VO2 film as a function of temperature and dopant concentration. We then task a set of domain experts and a set of machine learning experts with identifying which phase is present in each diffraction pattern manually and algorithmically, respectively; in both cases, the labels can vary dramatically, especially at the phase boundaries. We use the mode of the labels and the Shannon entropy as a method to capture, preserve and propagate consensus labels and their variance. Further we use the expert labels as a benchmark and demonstrate the use of Shannon entropy weighted scoring to test the performance of machine learning generated labels. Finally, we propose a material data challenge centered around generating improved labeling algorithms. This real-world dataset curated with expert labels can act as test bed for new algorithms. The raw data, annotations and code used in this study are all available online at data.gov and the interested reader is encouraged to replicate and improve the existing models

97 MATHEMATICS AND COMPUTING↗