Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Detailed Uncertainty Analysis of the Ares I A106 Liftoff/Transition Database

The Ares I A106 Liftoff/Transition Force and Moment Aerodynamics Database describes the aerodynamics of the Ares I Crew Launch Vehicle (CLV) from the moment of liftoff through the transition from high to low total angles of attack at low subsonic Mach numbers. The database includes uncertainty estimates that were developed using a detailed uncertainty quantification procedure. The Ares I Aerodynamics Panel developed both the database and the uncertainties from wind tunnel test data acquired in the NASA Langley Research Center s 14- by 22-Foot Subsonic Wind Tunnel Test 591 using a 1.75 percent scale model of the Ares I and the tower assembly. The uncertainty modeling contains three primary uncertainty sources: experimental uncertainty, database modeling uncertainty, and database query interpolation uncertainty. The final database and uncertainty model represent a significant improvement in the quality of the aerodynamic predictions for this regime of flight over the estimates previously used by the Ares Project. The maximum possible aerodynamic force pushing the vehicle towards the launch tower assembly in a dispersed case using this database saw a 40 percent reduction from the worst-case scenario in previously released data for Ares I.

Hanke, Jeremy L.↗

LCOE Uncertainty Analysis for Hydropower using Monte Carlo Simulations

Levelized Cost of Energy (LCOE) is an important metric to evaluate the cost and performance of electricity production generation alternatives, and combined with other measures, can be used to assess the economics of future hydropower development. Multiple assumptions on input parameters are required to calculate the LCOE, which each contain some level of uncertainty, in turn affecting the accuracy of LCOE results. This paper explores these uncertainties, their sources, and ultimately the level of variability they introduce at the screening level of project evaluation for non-powered dams (NPDs) across the U.S.Owing to site-specific differences in site design, the LCOE for hydropower varies significantly from project to project unlike technologies with more standardized configurations such as wind and gas. Therefore, to assess the impact of LCOE input uncertainty on the economics of U.S. hydropower resources, these uncertainties must be modeled across the population of potential opportunities. To demonstrate the impact of uncertainty, resource data from a recent nationwide non-powered dam (NPD) resource assessment (Hadjerioua et al., 2012) and screening-level predictive cost equations (O’Connor et al., 2015) are used to quantify and evaluate uncertainties in project capital and operations & maintenance costs, and generation potential at broad scale. LCOE dependence on financial assumptions is also evaluated on a sensitivity basis to explore ownership/investment implications on project economics for the U.S. hydropower fleet.The results indicate that the LCOE for U.S. NPDs varies substantially. The LCOE estimates for the potential NPD projects of capacity greater than 1 MW range from 40 to 182 $/MWh, with average of 106 $/MWh. 4,000 MW could be developed through projects with individual LCOE values below 100 $/MWh. The results also indicate that typically 90 % of LCOE uncertainty can be attributed to uncertainties in capital costs and energy production; however, for small projects (below 10 MW) O&M uncertainty plays an important role. The potential NPDs have costs with uncertainty bands extending well above 100 $/MWh in some cases. A truly representative evaluation should complement LCOE with an assessment of potential revenues from the provision of ancillary services. Moreover, hydroelectric production is often part of multipurpose water resource projects where other purposes (e.g., irrigation, flood control, navigation, recreation, etc.) also provide value. Neither of these considerations are accounted for LCOE.

Chalise, Dol Raj↗

Pre-launch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 that will be on-board Landsat 9 has undergone a pre-launch testing campaign to characterize its radiometric, spectral, and spatial performance and demonstrate compliance to its requirements. This work reviews key elements of the instrument-level radiometric testing using an SI traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 on-board blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a non-linear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument’s potential for enhancing our understanding of the Earth’s environment.

Landsat↗

Prelaunch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 (TIRS-2) that will be onboard Landsat 9 has undergone a prelaunch testing campaign to characterize its radiometric, spectral, and spatial performances and demonstrate compliance to its requirements. This work reviews the key elements of the instrument-level radiometric testing using an SI-traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 onboard blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a nonlinear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument's potential for enhancing our understanding of the Earth's environment.

Aaron Pearlman↗

Uncertainty Analysis of Coaxial Thermocouple Calorimeters Used in Arc Jets

Recent introduction of Coaxial Thermocouple type calorimeters into the NASA Ames arc jet facilities has inspired an analysis of 2D conduction effects internal to this type of calorimeter. Lateral conduction effects violate the 1D finite slab inverse analysis which is typically used to deduce the heat transfer to such calorimeters. The spherical shaped nose associated with most calorimeters (rather than flat) leads to a bias error that over-estimates the stagnation heating. Non-uniform heating on the face of spherically shaped calorimeters leads to conduction losses to the colder rim of the calorimeter which causes an underestimate of the stagnation heating. These two effects come into play at different times of the calorimeter's exposure to the arc jet, so they do not cancel. The spherical body effects come into play in the early stages of exposure, while the non-uniform heating effect becomes most severe at the later stages of exposure. The bias associated with spherical effects can be avoided by rewriting the 1D finite slab inverse analysis code to solve for 1D conduction in spherical coordinates. However, reducing the bias error associated non-uniform heating requires a somewhat ad hoc modification to the 1D finite element inverse analysis.

Isotherms↗

Video Scanning Hartmann Optical Tester (VSHOT) Uncertainty Analysis: Preprint

This purely analytical work is based primarily on the geometric optics of the system and shows sensitivities to various design and operational parameters. We discuss sources of error with measuring devices, instrument calibrations, and operator measurements for a parabolic trough test. In this paper, we include both the random (precision) and systematic (bias) errors for VSHOT testing and theircontributions to the uncertainty. The contributing factors that we considered in this study are target tilt, target face to laser output distance, instrument vertical offset, scanner tilt, distance between the tool and the test piece, camera calibration, and scanner/calibration.

14 SOLAR ENERGY↗

Uncertainty Analysis Framework for the Hospital Resource Supply Model for Covid-19

In March and April of 2020 there was widespread concern about availability of medical resources required to treat Covid-19 patients who become seriously ill. A simulation model of supply management was developed to aid understanding of how to best manage available supplies and channel new production. Forecasted demands for critical therapeutic resources have tremendous uncertainty, largely due to uncertainties about the number and timing of patient arrivals. It is therefore essential to evaluate any process for managing supplies in view of this uncertainty. To support such evaluations, we developed a modeling framework that would allow an integrated assessment in the context of uncertainty quantification. At the time of writing there has been no need to execute this framework because adaptations of the medical system have been able to respond effectively to the outbreak. This report documents the framework and its implemented components should need later arise for its application.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Lung Cancer in the Mayak Workers Cohort: Risk Estimation and Uncertainty Analysis

The workers at the Mayak nuclear facility near Ozyorsk, Russia are a primary source of information about exposure to radiation at low-dose rates, since they were subject to protracted exposures to external gamma rays and to internal exposures from plutonium inhalation. Here we re-examine lung cancer mortality rates and assess the effects of external gamma and internal plutonium exposures using recently developed Monte Carlo dosimetry systems. Using individual lagged mean annual lung doses computed from the dose realizations, we fit excess relative risk (ERR) models to the lung cancer mortality data for the Mayak Workers Cohort using risk-modeling software. We then used the corrected information matrix (CIM) approach to widen the confidence intervals of ERR by taking into account the uncertainty in doses represented by multiple realizations from the Monte Carlo dosimetry systems. Findings of this work revealed that there were 930 lung cancer deaths during follow-up. Plutonium lung doses (but not gamma doses) were generally higher in the new dosimetry systems than those used in the previous analysis. This led to a reduction in the risk per unit dose compared to prior estimates. The estimated ERR/Gy for external gamma-ray exposure was 0.19 (95% CI: 0.07 to 0.31) for both sexes combined, while the ERR/Gy for internal exposures based on mean plutonium doses were 3.5 (95% CI: 2.3 to 4.6) and 8.9 (95% CI: 3.4 to 14) for males and females at attained age 60. Accounting for uncertainty in dose had little effect on the confidence intervals for the ERR associated with gamma-ray exposure, but had a marked impact on confidence intervals, particularly the upper bounds, for the effect of plutonium exposure [adjusted 95% CIs: 1.5 to 8.9 for males and 2.7 to 28 for females]. In conclusion, lung cancer rates increased significantly with both external gamma-ray and internal plutonium exposures. Accounting for the effects of dose uncertainty markedly increased the width of the confidence intervals for the plutonium dose response but had little impact on the external gamma dose effect estimate. Adjusting risk estimate confidence intervals using CIM provides a solution to the important problem of dose uncertainty. This work demonstrates, for the first time, that it is possible and practical to use our recently developed CIM method to make such adjustments in a large cohort study.

uncertainty, radiation risk estimation, Mayak Prod↗

Uncertainty Analysis on the Design of Thermal Conductivity Measurement by a Guarded Cut-Bar Technique

A technique adapted from the guarded-comparative-longitudinal heat flow method was selected for the measurement of the thermal conductivity of a nuclear fuel compact over a temperature range characteristic of its usage. This technique fulfills the requirement for non-destructive measurement of the composite compact. Although numerous measurement systems have been created based on the guarded comparative method, comprehensive systematic (bias) and measurement (precision) uncertainty associated with this technique have not been fully analyzed. Using finite element modeling, this paper presents the study of two types of error sources in the thermal conductivity measurement process: sample and system geometries and working conditions. The results and conclusions provide valuable reference for designing and operating an experimental measurement system using this technique.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Analysis of Spectral Irradiance Reference Standards Used for NREL Calibrations

Spectral irradiance produced by lamp standards such as the National Institute of Standards and Technology (NIST) FEL-type tungsten halogen lamps are used to calibrate spectroradiometers at the National Renewable Energy Laboratory. Spectroradiometers are often used to characterize spectral irradiance of solar simulators, which in turn are used to characterize photovoltaic device performance, e.g., power output and spectral response. Therefore, quantifying the calibration uncertainty of spectroradiometers is critical to understanding photovoltaic system performance. In this study, we attempted to reproduce the NIST-reported input variables, including the calibration uncertainty in spectral irradiance for a standard NIST lamp, and quantify uncertainty for measurement setup at the Optical Metrology Laboratory at the National Renewable Energy Laboratory.

14 SOLAR ENERGY↗

Uncertainty analysis of trade-offs between multiple responses using hypervolume

When multiple responses are considered in process optimization, the degree to which they can be simultaneously optimized depends on the optimization objectives and the amount of trade-offs between the responses. The normalized hypervolume of the Pareto front is a useful summary to quantify the amount of trade-offs required to balance performance across the multiple responses. In order to quantify the impact of uncertainty of the estimated response surfaces and add realism to what future data to expect, 2 versions of the scaled normalized hypervolume of the Pareto front are presented. To demonstrate the variation of the hypervolume distributions, we explore a case study for a chemical process involving 3 responses, each with a different type of optimization goal. Our results show that the global normalized hypervolume characterizes the proximity to the ideal results possible, while the instance-specific summary considers the richness of the front and the severity of trade-offs between alternatives. Furthermore, the 2 scaling schemes complement each other and highlight different features of the Pareto front and hence are useful to quantify what solutions are possible for simultaneous optimization of multiple responses.

97 MATHEMATICS AND COMPUTING↗

Advanced Graphite Creep Uncertainty Analysis

Radiation damage estimation is an important component of the post irradiation analysis of the Advanced Graphite Creep (AGC) experiment. It depends primarily on the fast fluence, which is determined using well established methods of spectral adjustment. These are based on best estimates from models such as Monte Carlo N-Particle (MCNP), input cross-sections, and measured activities from flux wires in the experiment. Each of these parameters can propagate uncertainties which will affect the uncertainty in the calculated dose levels for AGC, or any experiment irradiated within a reactor. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to outline some deficiencies in the ways these input uncertainties are presently estimated, and to outline a methodology by which they can be improved. The fast fluence and radiation damage received by graphite specimens irradiated in the Advanced Graphite Creep (AGC) experiments is presently estimated using spectral adjustment methods that are based on both flux wire activity measurements, and MCNP model predictions. This work describes an ongoing effort to quantify and propagate uncertainties in inputs to the spectral adjustment process, and thereby quantify the resultant error in radiation damage (dpa) estimates. The effort is multi-faceted, and we consider the impacts of both the set of flux wires selected, and the counting process. An expanded set of flux wires is identified that provides a more comprehensive data set on the fast spectrum. To address the counting process itself, a series of round-robin measurements in several reactor metrology laboratories across the Department of Energy (DOE) complex and nuclear industry are being undertaken to refine the American Society for Testing and Materials (ASTM) standards for flux wire measurements. To address the contribution of uncertainty in the MCNP model predictions, an uncertainty quantification (UQ) tool has been developed that statistically samples the model input parameters, runs a series of cases, and assimilates the results to provide an overall uncertainty. The impact of the MCNP UQ tool results is demonstrated by re-analyzing previous AGC flux wire and irradiation data. While the expanded flux wire set obviously cannot be added to these experiments retroactively, plans for future graphite irradiations are outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Analysis of the Pitch Damping Coefficient of Blunt Bodies, Measured from Magnetic Suspension Wind Tunnel Tests

Blunt body aerodynamics in re-entry conditions are characterized by oscillatory behavior that is often encapsulated by the pitch damping coefficient (Cmq). Magnetic Suspension Wind Tunnel (MSWT) testing with a Magnetic Suspension Balance System (MSBS) aims to improve blunt body wind tunnel testing by removing the sometimes unknown aerodynamic effects of traditional sting mounts, as well as generate more constrained outputs than vertical spin tunnel testing. Efforts to calculate the uncertainty of the pitch damping coefficient with a proposed Earth Entry Vehicle (EEV) capsule model have been made by fitting an analytic prediction of the attitude time history to video data of a free-to-oscillate MSBS test.

Magnetic suspension, dynamic stability, uncertaint↗

A Framework to Support Generator Ramping Uncertainty Analysis and Visualization

Power system operation requires maintaining a continuous balance between system demand and generation within certain constraints. Traditionally, the balancing processes are based on deterministic models, which do not consider possible random deviations of system generation and load from their predicted values. With the increasing penetration of the renewable generation, unexpected balancing problems can happen due to the deviations. This can result in serious risks to system reliability and efficiency. When the available balancing reserve is not enough to cover the predicted net load range with uncertainty, deficiency of balancing needs occurs. In this case, it is necessary to commit or de-commit additional conventional generators to achieve the desired confidence level for the balancing needs. The framework is built for solving this problem. The ramping tool engine is used to predict additional balancing requirements caused by the variability and uncertainty of the renewable energy, under the constraints of the generation ramping capability and interchange schedule. The web browser- based GUI is used to visualize the data in web-environment, which provides flexibility to allow user to see the ramping outputs in any platform. The GOSS structure provides strong support to allow easy communication between ramping engine, and system inputs, as well as the GUI.

Chen, Yousu↗

Efficient Parametric Uncertainty Analysis of an Earth Entry Vehicle Concept Using Least Angle Regression

The objective of this work was to outline and apply an efficient and accurate parametric un-certainty propagation approach to the analysis of convective heating on an Earth entry vehicle concept. The described approach was based on Least Angle Regression used to solve a sparse and underdetermined linear system in the point-collocation non-intrusive polynomial chaos surrogate method. This approach involved an iterative process to computing the non-zero terms of the underlying polynomial chaos model using only enough samples to converge uncertainty interval predictions and Sobol index values based global nonlinear sensitivity estimates. The Earth entry vehicle was analyzed at three points along a representative trajectory for a Mars return mission. 329 sources of uncertainty were identified in the computational fluid dynamics model used to predict the forebody convective heating. These included uncertainty in flow field chemical rates, collision integrals, heats of formation, surface finite rate char model reaction rates, wall roughness height, and the turbulent Schmidt number. Results from this study showed that convective heating uncertainty as high as 50% of the nominal was predicted with only about 50 evaluations of the computational model. This was far fewer than would be required for a sampling-based approach or a full basis polynomial chaos model, which would have required over 50,000 samples. Additionally, results showed that over 90% of the total convective heating uncertainty was due to uncertainty in the N2catalytic rate on the surface, while the remainder of the uncertainty was attributed to the turbulent Schmidt number and the wall roughness uncertainties.

Thomas K West IV↗

Micro-Pulse Lidar Signals: Uncertainty Analysis

Micro-pulse lidar (MPL) systems are small, autonomous, eye-safe lidars used for continuous observations of the vertical distribution of cloud and aerosol layers. Since the construction of the first MPL in 1993, procedures have been developed to correct for various instrument effects present in MPL signals. The primary instrument effects include afterpulse, laser-detector cross-talk, and overlap, poor near-range (less than 6 km) focusing. The accurate correction of both afterpulse and overlap effects are required to study both clouds and aerosols. Furthermore, the outgoing energy of the laser pulses and the statistical uncertainty of the MPL detector must also be correctly determined in order to assess the accuracy of MPL observations. The uncertainties associated with the afterpulse, overlap, pulse energy, detector noise, and all remaining quantities affecting measured MPL signals, are determined in this study. The uncertainties are propagated through the entire MPL correction process to give a net uncertainty on the final corrected MPL signal. The results show that in the near range, the overlap uncertainty dominates. At altitudes above the overlap region, the dominant source of uncertainty is caused by uncertainty in the pulse energy. However, if the laser energy is low, then during mid-day, high solar background levels can significantly reduce the signal-to-noise of the detector. In such a case, the statistical uncertainty of the detector count rate becomes dominant at altitudes above the overlap region.

Welton, Ellsworth J.↗

Uncertainty analysis of wavelet-based feature extraction for isotope identification on NaI gamma-ray spectra

Low-resolution isotope identifiers are widely deployed for nuclear security purposes, but these detectors currently demonstrate problems in making correct identifications in many typical usage scenarios. While there are many hardware alternatives and improvements that can be made, performance on existing low resolution isotope identifiers should be able to be improved by developing new identification algorithms. We have developed a wavelet-based peak extraction algorithm and an implementation of a Bayesian classifier for automated peak-based identification. The peak extraction algorithm has been extended to compute uncertainties in the peak area calculations. To build empirical joint probability distributions of the peak areas and uncertainties, a large set of spectra were simulated in MCNP6 and processed with the wavelet-based feature extraction algorithm. Kernel density estimation was then used to create a new component of the likelihood function in the Bayesian classifier. Furthermore, identification performance is demonstrated on a variety of real low-resolution spectra, including Category I quantities of special nuclear material.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Analysis of Experimental Discharge Coefficients in Additively Manufactured Liquid Injector Elements

Screening of two additively manufactured liquid injector designs was conducted in the UAH high pressure spray facility. Four variants of each geometry with slightly different dimensions were obtained from eleven separate commercial additive manufacturing services. The devices were manufactured from Inconel 625 using the selective laser melting (SLM) powder bed process. The devices were cold flowed with water over a range of relevant pressure drops (75 psi to 1500 psi) to produce water flow rates from 0.037 to 1.75 lbm/s into ambient back pressure. Discharge coefficients determined from the testing along with the associated uncertainties provide insight into characteristic flow performance variabilities that can be expected from the SLM process for similar geometries.

Venters, James P.↗