Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Uncertainty of Rotating Shadowband Irradiometers and Si-Pyranometers Including the Spectral Irradiance Error

Concentrating solar power projects require accurate direct normal irradiance (DNI) data including uncertainty specifications for plant layout and cost calculations. Ground measured data are necessary to obtain the required level of accuracy and are often obtained with Rotating Shadowband Irradiometers (RSI) that use photodiode pyranometers and correction functions to account for systematic effects. The uncertainty of Si-pyranometers has been investigated, but so far basically empirical studies were published or decisive uncertainty influences had to be estimated based on experience in analytical studies. One of the most crucial estimated influences is the spectral irradiance error because Si-photodiode-pyranometers only detect visible and color infrared radiation and have a spectral response that varies strongly within this wavelength interval. Furthermore, analytic studies did not discuss the role of correction functions and the uncertainty introduced by imperfect shading. In order to further improve the bankability of RSI and Si-pyranometer data, a detailed uncertainty analysis following the Guide to the Expression of Uncertainty in Measurement (GUM) has been carried out. The study defines a method for the derivation of the spectral error and spectral uncertainties and presents quantitative values of the spectral and overall uncertainties. Data from the PSA station in southern Spain was selected for the analysis. Average standard uncertainties for corrected 10 min data of 2% for global horizontal irradiance (GHI), and 2.9% for DNI (for GHI and DNI over 300 W/m2) were found for the 2012 yearly dataset when separate GHI and DHI calibration constants were used. Also the uncertainty in 1 min resolution was analyzed. The effect of correction functions is significant. The uncertainties found in this study are consistent with results of previous empirical studies.

14 SOLAR ENERGY↗

Quality quandaries: Statistical detective work to understand the isotopic ratios in Drum 68660 and the radioactive release at WIPP

An incident at the Department of Energy's Waste Isolation Pilot Plant (WIPP) in 2014 resulted in the release of radioactive material into the environment. Initially, it was known that at least one drum in WIPP, identified as drum 68660, was involved. However, questions remained. Could the air-monitor isotopic ratios measured in WIPP at the time of the release be explained by materials in drum 68660 or were other drums involved? Could internal conditions in drum 68660 have caused the breach? What were the implications for 68660's sister drum? These questions needed to be answered as quickly as possible. Here, this analysis, which was completed in three weeks, combined combinatorics and uncertainty analysis to provide scientists with the timely evidence they needed to either answer these important questions or to design experiments to answer them.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Atmospheric Inverse Estimates of Methane Emissions from Central California

Methane mixing ratios measured at a tall-tower are compared to model predictions to estimate surface emissions of CH{sub 4} in Central California for October-December 2007 using an inverse technique. Predicted CH{sub 4} mixing ratios are calculated based on spatially resolved a priori CH{sub 4} emissions and simulated atmospheric trajectories. The atmospheric trajectories, along with surface footprints, are computed using the Weather Research and Forecast (WRF) coupled to the Stochastic Time-Inverted Lagrangian Transport (STILT) model. An uncertainty analysis is performed to provide quantitative uncertainties in estimated CH{sub 4} emissions. Three inverse model estimates of CH{sub 4} emissions are reported. First, linear regressions of modeled and measured CH{sub 4} mixing ratios obtain slopes of 0.73 {+-} 0.11 and 1.09 {+-} 0.14 using California specific and Edgar 3.2 emission maps respectively, suggesting that actual CH{sub 4} emissions were about 37 {+-} 21% higher than California specific inventory estimates. Second, a Bayesian 'source' analysis suggests that livestock emissions are 63 {+-} 22% higher than the a priori estimates. Third, a Bayesian 'region' analysis is carried out for CH{sub 4} emissions from 13 sub-regions, which shows that inventory CH{sub 4} emissions from the Central Valley are underestimated and uncertainties in CH{sub 4} emissions are reduced for sub-regions near the tower site, yielding best estimates of flux from those regions consistent with 'source' analysis results. The uncertainty reductions for regions near the tower indicate that a regional network of measurements will be necessary to provide accurate estimates of surface CH{sub 4} emissions for multiple regions.

54 ENVIRONMENTAL SCIENCES↗

Comparison of XSUSA and "Two-Step" Approaches for Full Core Uncertainty Quantification

While there are multiple sources of error that are introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily for quantifying the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the 'Two-Step' method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the Two-Step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution will be examined in the framework of phase I-3 of the UAM Benchmark. Using the TMI core as a base model for analysis, the XSUSA and Two-Step methods are applied with certain limitations and the results are compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions are made for which method is currently a more viable option for computing uncertainties in burnup and transient calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comparison of XSUSA and 'two-step' approaches for full-core uncertainty quantification

While there are multiple sources of error that are introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily for quantifying the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the 'Two-Step' method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the Two-Step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution will be examined in the framework of phase 1-3 of the UAM Benchmark. Using the TMI core as a base model for analysis, the XSUSA and Two-Step methods are applied with certain limitations and the results are compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions are made for which method is currently a more viable option for computing uncertainties in burnup and transient calculations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗

Development of new baseline models for U.S. medium office buildings based on commercial buildings energy consumption survey data

Building energy estimation for the building sector under various scenarios are needed for building energy regulation and policy making. This often starts with representative baselines (either empirical baseline or modeled baseline). Commercial Buildings Energy Consumption Survey (CBECS) data is a widely used empirical baseline for U.S. commercial buildings, but none of the existing baseline model are developed to represent the CBECS data. This paper aims to develop new baseline models for the U.S. medium office buildings, which can produce modeled baselines consistent with the CBECS data. Here, we introduced the methodology to create baseline models and the criteria to evaluate the performance of baseline models. The methodology consists of three phases: (1) identification of model inputs, (2) model calibration, and (3) model validation with uncertainty analysis. The evaluation index is the coefficient of variation of the root-mean-square deviation (CV(RMSD)) of site energy use intensities (EUIs) between the modeled baseline and empirical baseline. Then 30 new baseline models for two vintages (pre- and post-1980) and 15 climate zones were created. The evaluation shows that the CV(RMSD) is lower than 0.05 for the modeled baselines produced by the new baseline models. As a comparison, the CV(RMSD) is higher than 0.1 for the existing modeled baselines generated by DOE Commercial Reference Building Models. Further analysis shows that the new baseline models are able to capture the uncertainties of the representative features of existing buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Practical Use of Computationally Frugal Model Analysis Methods

Computationally frugal methods of model analysis can provide substantial benefits when developing models of groundwater and other environmental systems. Model analysis includes ways to evaluate model adequacy and to perform sensitivity and uncertainty analysis. Frugal methods typically require 10s of parallelizable model runs; their convenience allows for other uses of the computational effort. We suggest that model analysis be posed as a set of questions used to organize methods that range from frugal to expensive (requiring 10,000 model runs or more). This encourages focus on method utility, even when methods have starkly different theoretical backgrounds. We note that many frugal methods are more useful when unrealistic process-model nonlinearities are reduced. Inexpensive diagnostics are identified for determining when frugal methods are advantageous. Examples from the literature are used to demonstrate local methods and the diagnostics. We suggest that the greater use of computationally frugal model analysis methods would allow questions such as those posed in this work to be addressed more routinely, allowing the environmental sciences community to obtain greater scientific insight from the many ongoing and future modeling efforts

54 ENVIRONMENTAL SCIENCES↗

Verification of Reduced Order Modeling Based Uncertainty/Sensitivity Estimator (ROMUSE)

This article presents a number of verification case studies for a recently developed sensitivity/uncertainty code package. The code package, ROMUSE (Reduced Order Modeling based Uncertainty/Sensitivity Estimator) is an effort to provide an analysis tool to be used in conjunction with reactor core simulators, in particular the Virtual Environment for Reactor Applications (VERA) core simulator. ROMUSE has been written in C++ and is currently capable of performing various types of parameter perturbations and associated sensitivity analysis, uncertainty quantification, surrogate model construction and subspace analysis. The current version 2.0 has the capability to interface with the Design Analysis Kit for Optimization and Terascale Applications (DAKOTA) code, which gives ROMUSE access to the various algorithms implemented within DAKOTA, most importantly model calibration. The verification study is performed via two basic problems and two reactor physics models. The first problem is used to verify the ROMUSE single physics gradient-based range finding algorithm capability using an abstract quadratic model. The second problem is the Brusselator problem, which is a coupled problem representative of multi-physics problems. This problem is used to test the capability of constructing surrogates via ROMUSE-DAKOTA. Finally, light water reactor pin cell and sodium-cooled fast reactor fuel assembly problems are simulated via SCALE 6.1 to test ROMUSE capability for uncertainty quantification and sensitivity analysis purposes.

97 MATHEMATICS AND COMPUTING↗

Extension of SCALE/Sampler’s sensitivity analysis

Nuclear data are a major source of uncertainties in reactor physics calculations. The propagation of nuclear data uncertainties to important system responses is instrumental when determining appropriate safety margins in reactor safety analyses. It is also important to understand the major contributors to the observed uncertainties to make recommendations for further measurements and evaluations and aid in the understanding of the studied system. The SCALE code system allows for nuclear data uncertainty analysis based on the random sampling approach as implemented in SCALE’s Sampler sequence. Sampler was recently extended by a sensitivity analysis in terms of the calculation of two correlation-based sensitivity indices. This analysis allows for the identification of the top contributing nuclear reactions to any analyzed output uncertainty. This paper presents the sensitivity indices, along with their interpretation and limitations. It demonstrates the application in an eigenvalue and decay heat analysis for a boiling water reactor fuel assembly.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Nuclear data uncertainty and sensitivity analysis of the VHTRC benchmark using SCALE

The Very High Temperature Critical Assembly (VHTRC) experiment represents one of the few data sets available for the validation of HTGR lattice physics. Within the framework of the IAEA Coordinated Research Project on HTGR Uncertainty Analysis in Modeling, uncertainty and sensitivity analyses of this graphite-moderated facility are performed as the validation reference to the prismatic MHTGR-350 fuel block calculations. Nominal multi-group and continuous-energy criticality calculations with the KENO-VI Monte Carlo code of the SCALE code package are compared with the continuous-energy Monte Carlo Code Serpent. Good agreement with a maximum difference of 250 pcm is obtained. The experimental data set, however, differs by several hundred pcm with the results of both codes when using the ENDF-VII.0 library. When using ENDF/B-VII.1 data, this difference is reduced to a few hundred pcm and the calculations lie within the experimental error bars. Uncertainties of the VHTRC multiplication factors due to uncertainties in nuclear data are determined with SAMPLER/KENO-VI of SCALE 6.2 and with continuous-energy TSUNAMI of SCALE 6.2. For all experimental configurations, the obtained uncertainty is found to be 0.58% when using ENDF/B-VII.0 data. The top contributor to this uncertainty is the average number of neutrons per fission event of U-235. With ENDF/B-VII.1 data, uncertainties of about 0.66% are obtained in particular due to an increased uncertainty of U-235 nu-bar in the latest ENDF release. In conclusion, when considering these nuclear data uncertainties, the obtained 1s uncertainty intervals are overlapping with the experimental error bars.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Full elastic strain and stress tensor measurements from individual dislocation cells in copper through-Si vias

We report non-destructive measurements of the full elastic strain and stress tensors from individual dislocation cells distributed along the full extent of a 50 mm-long polycrystalline copper via in Si is reported. Determining all of the components of these tensors from sub-micrometre regions within deformed metals presents considerable challenges. The primary issues are ensuring that different diffraction peaks originate from the same sample volume and that accurate determination is made of the peak positions from plastically deformed samples. For these measurements, three widely separated reflections were examined from selected, individual grains along the via. The lattice spacings and peak positions were measured for multiple dislocation cell interiors within each grain and the cell-interior peaks were sorted out using the measured included angles. A comprehensive uncertainty analysis using a Monte Carlo uncertainty algorithm provided uncertainties for the elastic strain tensor and stress tensor components.

36 MATERIALS SCIENCE↗

Development of a water calorimetry-based standard for absorbed dose to water in HDR {sup 192}Ir brachytherapy

Purpose: The aim of this article is to develop and evaluate a primary standard for HDR {sup 192}Ir brachytherapy based on 4 deg. C stagnant water calorimetry. Methods: The absolute absorbed dose to water was directly measured for several different Nucletron microSelectron {sup 192}Ir sources of air kerma strength ranging between 21 000 and 38 000 U and for source-to-detector separations ranging between 25 and 70 mm. The COMSOL MULTIPHYSICS software was used to accurately calculate the heat transport in a detailed model geometry. Through a coupling of the ''conduction and convection'' module with the ''Navier-Stokes incompressible fluid'' module in the software, both the conductive and convective effects were modeled. Results: A detailed uncertainty analysis resulted in an overall uncertainty in the absorbed dose of 1.90%(1{sigma}). However, this includes a 1.5% uncertainty associated with a nonlinear predrift correction which can be substantially reduced if sufficient time is provided for the system to come to a new equilibrium in between successive calorimetric runs, an opportunity not available to the authors in their clinical setting due to time constraints on the machine. An average normalized dose rate of 361{+-}7 {mu}Gy/(h U) at a source-to-detector separation of 55 mm was measured for the microSelectron {sup 192}Ir source based on water calorimetry. The measured absorbed dose per air kerma strength agreed to better than 0.8%(1{sigma}) with independent ionization chamber and EBT-1 Gafchromic film reference dosimetry as well as with the currently accepted AAPM TG-43 protocol measurements. Conclusions: This work paves the way toward a primary absorbed dose to water standard in {sup 192}Ir brachytherapy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Uncertainty of Five-Hole Probe Measurements

A new algorithm for five-hole probe calibration and data reduction using a non-nulling technique was developed, verified, and reported earlier (Wendt and Reichert, 1993). The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify the uncertainty of five-hole probe results (e.g., total pressure, static pressure, and flow direction) and to determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance for improving the measurement technique.

Reichert, Bruce A.↗

Ignoring correlation in uncertainty and sensitivity analysis in life cycle assessment: what is the risk?

Life cycle assessment (LCA) is an established tool to quantify the environmental impact of a product. A good assessment of uncertainty is important for making well-informed decisions in comparative LCA, as well as for correctly prioritising data collection efforts. Under- or overestimation of output uncertainty (e.g. output variance) will lead to incorrect decisions in such matters. The presence of correlations between input parameters during uncertainty propagation, can increase or decrease the the output variance. However, most LCA studies that include uncertainty analysis, ignore correlations between input parameters during uncertainty propagation, which may lead to incorrect conclusions. Two approaches to include correlations between input parameters during uncertainty propagation and global sensitivity analysis were studied: an analytical approach and a sampling approach. The use of both approaches is illustrated for an artificial case study of electricity production. Results demonstrate that both approaches yield approximately the same output variance and sensitivity indices for this specific case study. Furthermore, we demonstrate that the analytical approach can be used to quantify the risk of ignoring correlations between input parameters during uncertainty propagation in LCA. We demonstrate that: (1) we can predict if including correlations among input parameters in uncertainty propagation will increase or decrease output variance; (2) we can quantify the risk of ignoring correlations on the output variance and the global sensitivity indices. Moreover, this procedure requires only little data. - Highlights: • Ignoring correlation leads to under- or overestimation of the output variance. • We demonstrated that the risk of ignoring correlation can be quantified. • The procedure proposed is generally applicable in life cycle assessment. • In some cases, ignoring correlation has a minimal effect on decision-making tools.

54 ENVIRONMENTAL SCIENCES↗

Lowering post‐construction yield assessment uncertainty through better wind plant power curves

Abstract Many operational analyses of wind power plants require a statistical relationship, which can be called the wind plant power curve, to be developed between wind plant energy production and concurrent atmospheric variables. Currently, a univariate linear regression at monthly resolution is the industry standard for post‐construction yield assessments. Here, we evaluate the benefits in augmenting this conventional approach by testing alternative regressions performed with multiple inputs, at a finer time resolution, and using nonlinear machine‐learning algorithms. We utilize the National Renewable Energy Laboratory's open‐source software package OpenOA to assess wind plant power curves for 10 wind plants. When a univariate generalized additive model at daily or hourly resolution is used, regression uncertainty is reduced, in absolute terms, by up to 1.0 % and 1.2 % (corresponding to a −59 % and −80 % relative change), respectively, compared to a univariate linear regression at monthly resolution; also, a more accurate assessment of the mean long‐term wind plant production is achieved. Additional input variables also reduce the regression uncertainty: when temperature is added as an input to the conventional monthly linear regression, the operational analysis uncertainty connected to regression is reduced, in absolute terms, by up to 0.5 % (−43 % relative change) for wind power plants with strong seasonal variability. Adding input variables to the machine‐learning model at daily resolution can further reduce regression uncertainty, with up to a −10 % relative change. Based on these results, we conclude that a multivariate nonlinear regression at daily or hourly resolution should be recommended for assessing wind plant power curves.

17 WIND ENERGY↗

Data for "Quantifying the Propagation of Parametric Uncertainty on Flux Balance Analysis"

In the repository are example scripts that perform uncertainty injection and propagation to flux balance analysis with outputs for a small sample size (for demonstration purpose only). For proper analysis, user should download the scripts and run for a large sample size (e.g., 10,000 samples). If you use the scripts, please cite the following Metabolic Engineering article: “Quantifying the propagation of parametric uncertainty on flux balance analysis” (https://doi.org/10.1016/j.ymben.2021.10.012) There are two subdirectories: /uncFBA/uncBiom: injection of normally distributed noise to biomass precursor coeffcients and ATP maintenance (growth-associated ATP maintenance (GAM) and non-growth associated ATP maintenance (NGAM)) /uncFBA/uncRHS: departure from steady-state by adding noise drawn from normal distribution to the RHS terms of mass balance constraints

Metabolomics↗

Uncertainty estimates in geomagnetic field modeling

This paper presents an extension of the conventional uncertainty analysis which characterizes the sources of uncertainty in the coefficients of the geomagnetic field models. The new formalism accounts for the systematic errors introduced by the omission of such sources as the presence of crustal fields, the external fields, and the field from the truncated terms. The usefulness of this formalism depends on two critical conditions. The first of these is the knowledge of the statistical properties of the fields whose parameters are not solved in the analysis, i.e., the crustal field and the external field. The second critical point in the practical use of the method is the approximation used for the weight matrix.

Langel, R. A.↗