Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Identifying and Analyzing Uncertainty Structures in the TRMM Microwave Imager Precipitation Product over Tropical Ocean Basins

Despite continuous improvements in microwave sensors and retrieval algorithms, our understanding of precipitation uncertainty is quite limited, due primarily to inconsistent findings in studies that compare satellite estimates to in situ observations over different parts of the world. This study seeks to characterize the temporal and spatial properties of uncertainty in the Tropical Rainfall Measuring Mission Microwave Imager surface rainfall product over tropical ocean basins. Two uncertainty analysis frameworks are introduced to qualitatively evaluate the properties of uncertainty under a hierarchy of spatiotemporal data resolutions. The first framework (i.e. 'climate method') demonstrates that, apart from random errors and regionally dependent biases, a large component of the overall precipitation uncertainty is manifested in cyclical patterns that are closely related to large-scale atmospheric modes of variability. By estimating the magnitudes of major uncertainty sources independently, the climate method is able to explain 45-88% of the monthly uncertainty variability. The percentage is largely resolution dependent (with the lowest percentage explained associated with a 1 deg x 1 deg spatial/1 month temporal resolution, and highest associated with a 3 deg x 3 deg spatial/3 month temporal resolution). The second framework (i.e. 'weather method') explains regional mean precipitation uncertainty as a summation of uncertainties associated with individual precipitation systems. By further assuming that self-similar recurring precipitation systems yield qualitatively comparable precipitation uncertainties, the weather method can consistently resolve about 50 % of the daily uncertainty variability, with only limited dependence on the regions of interest.

Climate↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6-Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at the NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6- Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗

Measurement uncertainty for the Uniform Engine Testing Program conducted at NASA Lewis Research Center

An uncertainty analysis was conducted to determine the bias and precision errors and total uncertainty of measured turbojet engine performance parameters. The engine tests were conducted as part of the Uniform Engine Test Program which was sponsored by the Advisory Group for Aerospace Research and Development (AGARD). With the same engines, support hardware, and instrumentation, performance parameters were measured twice, once during tests conducted in test cell number 3 and again during tests conducted in test cell number 4 of the NASA Lewis Propulsion Systems Laboratory. The analysis covers 15 engine parameters, including engine inlet airflow, engine net thrust, and engine specific fuel consumption measured at high rotor speed of 8875 rpm. Measurements were taken at three flight conditions defined by the following engine inlet pressure, engine inlet total temperature, and engine ram ratio: (1) 82.7 kPa, 288 K, 1.0, (2) 82.7 kPa, 288 K, 1.3, and (3) 20.7 kPa, 288 K, 1.3. In terms of bias, precision, and uncertainty magnitudes, there were no differences between most measurements made in test cells number 3 and 4. The magnitude of the errors increased for both test cells as engine pressure level decreased. Also, the level of the bias error was two to three times larger than that of the precision error.

Abdelwahab, Mahmood↗

Uncertainty Budget for Detector-Based Absolute Radiometric Calibration With GLAMR

The accuracy of the absolute radiometric calibration (RadCal) for remote sensing instruments is essential to their wide range of applications. The uncertainty associated to the traditional source-based RadCal method is assessed at a 2% (k=1) or higher level for radiance measurement. To further improve the accuracy to meet the demands of climate studies, a detector-based approach using tunable lasers as a light source has been devised. The Goddard Laser for Absolute Measurement of Radiance, known as the GLAMR system, is a notable example of the incorporation of such technology. Using transfer radiometers calibrated at NIST as calibration standards, the absolute spectral response (ASR) function of a remote sensing instrument is measured with its uncertainty traceable to the International System of Units. This paper presents a comprehensive uncertainty analysis of the detector-based absolute RadCal using the GLAMR system. It identifies and examines uncertainty sources during the GLAMR RadCal test, including those from the GLAMR system, the testing configuration, and data processing methodologies. Analysis is carried out to quantify the contribution of each source and emphasize the most influential factors. It is shown that the calibration uncertainty of GLAMR RadCal can be better than 0.3% (k=1) in the wavelength range of 350-950 nm and 0.6% (k=1) between 950-2300 nm, with the exception of regions with strong water absorption. In addition, recommendations are made to refine the calibration process to further reduce the uncertainty.

Zhipeng Wang↗

Calibration Probe Uncertainty and Validation for the Hypersonic Material Environmental Test System

This paper presents an uncertainty analysis of the stagnation-point calibration probe surface predictions for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System facility located at NASA Langley Research Center. A second-order stochastic expansion was constructed over 47 uncertain parameters to evaluate the sensitivities, identify the most significant uncertain variables, and quantify the uncertainty in the stagnation-point heat flux and pressure predictions of the calibration probe for a low- and high-enthalpy test condition. A sensitivity analysis showed that measurement bias uncertainty is the most significant contributor to the stagnation-point pressure and heat flux variance for the low-enthalpy condition. For the high-enthalpy condition, a paradigm shift in sensitivities revealed the computational fluid dynamics model input uncertainty as the main contributor. A comparison between the prediction and measurement of the stagnation-point conditions under uncertainty showed that there was evidence of statistical disagreement. A validation metric was proposed and applied to the prediction uncertainty to account for the statistical disagreement when compared to the possible stagnation-point heat flux and pressure measurements.

Brune, Andrew J.↗

Simultaneous three-dimensional velocity and mixing measurements by use of laser Doppler velocimetry and fluorescence probes in a water tunnel

A water tunnel investigation was conducted to demonstrate the capabilities of a laser-based instrument that can measure velocity and fluorescence intensity simultaneously. Fluorescence intensity of an excited fluorescent dye is directly related to concentration level and is used to indicate the extent of mixing in flow. This instrument is a three-dimensional laser Doppler velocimeter (LDV) in combination with a fluorometer for measuring fluorescence intensity variations. This capability allows simultaneous flow measurements of the three orthogonal velocity components and mixing within the same region. Two different flows which were generated by two models were studied: a generic nonaxisymmetric nozzle propulsion simulation model with an auxiliary internal water source that generated a jet flow and an axisymmetric forebody model with a circular sector strake that generated a vortex flow. The off-body flow fields around these models were investigated in the Langley 16- by 24-Inch Water Tunnel. The experimental results were used to calculate 17 quantities that included mean and fluctuating velocities, Reynolds stresses, mean and fluctuating dye fluorescence intensities (proportional to concentration), and fluctuating velocity and dye concentration correlations. An uncertainty analysis was performed to establish confidence levels in the experimental results. In general, uncertainties in mean velocities varied between 1 and 7 percent of free-stream velocity; uncertainties in fluctuating velocities varied between 1 and 5 percent of reference values. The results show characteristics that are unique to each type of flow.

Neuhart, Dan H.↗

Delayed Critical Highly Enriched Uranium Metal Cylinders with Thin Graphite Top and Bottom Reflectors

Nine 7, 11, and 15 in. diam highly enriched uranium (HEU, 93.15 wt % 235 U) metal cylinders were assembled on the vertical assembly machine in the Oak Ridge Critical Experiments Facility (ORCEF) and had 1, 2, or 3 in. thick HLM graphite reflectors on the top and bottom. The experiments, which were performed between April 3, 1970, and February 18, 1971, used 23 operational days at ORCEF. Before those experiments were carried out, unreflected and unmoderated, graphite- and polyethylene-reflected, and polyethylene-moderated HEU metal cylinders had been assembled to obtain delayed criticality at ORCEF in the 1960s and reported by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) at the Nuclear Energy Agency (NEA)*. The data from the nine critical experiments are acceptable for use as criticality safety benchmark experiments for the NEA’s ICSBEP once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with HEU metal at ORCEF, the uncertainties in k eff are expected to be as low as ±0.0004.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Rayleigh Scattering Diagnostic for Dynamic Measurement of Velocity and Temperature

A new technique for measuring dynamic gas velocity and temperature is described. The technique is based on molecular Rayleigh scattering of laser light, so no seeding of the flow is necessary. The Rayleigh scattered light is filtered with a fixed cavity, planar mirror Fabry-Perot interferometer. A minimum number of photodetectors were used in order to allow the high data acquisition rate needed for dynamic measurements. One photomultiplier tube (PMT) was used to measure the total Rayleigh scattering, which is proportional to the gas density. Two additional PMTs were used to detect light that passes through two apertures in a mask located in the interferometer fringe plane. An uncertainty analysis was used to select the optimum aperture parameters and to predict the measurement uncertainty due to photon shot-noise. Results of an experiment to measure the velocity of a subsonic free jet are presented.

Seasholtz, Richard G.↗

The Activity Profiles and Peak Flux of Radar Meteor Showers

Meteor showers are transient phenomena; a limited duration is what distinguishes a shower from a sporadic source. They do not, however, have clear start and end times; instead, shower activity gradually (or rapidly) increases over time, reaches a peak, and then decays. In this report, we examine the activity profiles of 38 meteor showers using 20 years of single-station shower fluxes from the Canadian Meteor Orbit Radar (CMOR). We find that a number of showers, such as the Southern delta Aquariids (SDAs), exhibit a broad maximum in activity rather than a sharp peak. We also find that approximately one-third of showers exhibit asymmetric activity profiles in which the rate in which activity rises prior to the peak differs from the rate at which it decays after the peak. We provide a functional form for meteor shower activity profiles that incorporates these features and use these profile fits to estimate each shower’s peak flux. This report also includes an uncertainty analysis for CMOR fluxes. This includes the first (to our knowledge) characterization of systematic uncertainty in radar meteor fluxes.

A V Moorhead↗

Impact of Model Uncertainties on Quantitative Analysis of FUV Auroral Images: Peak Production Height

We demonstrate that small uncertainties in the modeled height of peak production for FUV emissions can lead to significant uncertainties in the analysis of these sai-ne emissions. In particular, an uncertainty of only 3 km in the peak production height can lead to a 50% uncertainty in the mean auroral energy deduced from the images. This altitude uncertainty is comparable to differences in different auroral deposition models currently used for UVI analysis. Consequently, great care must be taken in quantitative photometric analysis and interpretation of FUV auroral images.

Germany, G. A.↗

Probabilistic Risk Analysis and Margin Process for a Flexible Thermal Protection System

Atmospheric entry vehicle thermal protection systems are margined due to the uncertainties that exist in entry aeroheating environments and the thermal response of the materials and structures. Entry vehicle thermal protections systems are traditionally over-margined for the heat loads that are experienced along the entry trajectory by designing to survive stacked worst-case scenarios. Additionally, the conventional heat shield design and margin process offers very little insight into the risk of over-temperature during flight and the corresponding reliability of the heat shield performance. A probabilistic margin process can be used to appropriately margin the thermal protection system based on rigorously calculated risk of failure. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and risk trades while preventing excessive margin from being applied. This study presents the methods of the probabilistic margin process and how the uncertainty analysis is used to determine the reliability of the entry vehicle thermal protection system and associated risks of failure.

Tobin, Steven A.↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul↗

Multi-Band Atmospheric Correction Algorithm for Ocean Color Retrievals

NASA's current Atmospheric Correction (AC) algorithm for ocean color utilizes two bands and their ratio in the Near Infrared (NIR) to estimate aerosol reflectance and aerosol type. The algorithm then extrapolates the spectral dependence of aerosol reflectance to the visible wavelengths based on modeled spectral dependence of the identified aerosol type. Future advanced ocean color sensors, such as the Ocean Color Instrument (OCI) that will be carried on the Plankton, Aerosol, Cloud, and ocean Ecosystem (PACE) satellite, will be capable of measuring the hyperspectral radiance from 340 to 890 nm at 5-nm spectral resolution and at 7 discrete Short-wave Infrared (SWIR) channels: 940, 1038,1250, 1378, 1615, 2130, and 2260 nm. To optimally employ this unprecedented instrument capability, we propose an improved AC algorithm that utilizes all atmospheric-window channels in the NIR to SWIR spectral range to reduce the uncertainty in the AC process. A theoretical uncertainty analysis of this, namely Multi-Band AC (MBAC), indicates that the algorithm can reduce the uncertainty in remote sensing reflectance (Rrs) retrievals of the ocean caused by sensor random noise. Furthermore, in optically complex waters, where the NIR signal is affected by contributions from highly-reflective turbid waters, the MBAC algorithm can be adaptively weighted to the strongly-absorbing SWIR channels to enable improved ocean color retrievals in coastal waters. We provide here a description of the algorithm and demonstrate the improved performance in ocean color retrievals, relative to the current NASA standard AC algorithm, through comparison with field measurements and assessment of propagated uncertainties in applying the MBAC algorithm to MODIS and simulated PACE OCI data.

PACE↗

Study of Aerothermodynamic Modeling Issues Relevant to High-Speed Sample Return Vehicles

This paper examines the application of state-of-the-art coupled ablation and radiation simulations to highspeed sample return vehicles, such as those returning from Mars or an asteroid. A defining characteristic of these entries is that the surface recession rates and temperatures are driven by nonequilibrium convective and radiative heating through a boundary layer with significant surface blowing and ablation products. Measurements relevant to validating the simulation of these phenomena are reviewed and the Stardust entry is identified as providing the best relevant measurements. A coupled ablation and radiation flowfield analysis is presented that implements a finite-rate surface chemistry model. Comparisons between this finite-rate model and a equilibrium ablation model show that, while good agreement is seen for diffusion-limited oxidation cases, the finite-rate model predicts up to 50% lower char rates than the equilibrium model at sublimation conditions. Both the equilibrium and finite rate models predict significant negative mass flux at the surface due to sublimation of atomic carbon. A sensitivity analysis to flowfield and surface chemistry rates show that, for a sample return capsule at 10, 12, and 14 km/s, the sublimation rates for C and C3 provide the largest changes to the convective flux, radiative flux, and char rate. A parametric uncertainty analysis of the radiative heating due to radiation modeling parameters indicates uncertainties ranging from 27% at 10 km/s to 36% at 14 km/s. Applying the developed coupled analysis to the Stardust entry results in temperatures within 10% of those inferred from observations, and final recession values within 20% of measurements, which improves upon the 60% over-prediction at the stagnation point obtained through an uncoupled analysis. Emission from CN Violet is shown to be over-predicted by nearly and order-of-magnitude, which is consistent with the results of previous independent analyses. Finally, the coupled analysis is applied to a 14 km/s Earth entry representative of a Mars sample return. Although the radiative heating provides a larger fraction of the total heating, the influence of ablation and radiation on the flowfield are shown to be similar to Stardust.

Johnston, Christopher O.↗

Helium Mass Spectrometer Leak Detection: A Method to Quantify Total Measurement Uncertainty

In applications where leak rates of components or systems are evaluated against a leak rate requirement, the uncertainty of the measured leak rate must be included in the reported result. However, in the helium mass spectrometer leak detection method, the sensitivity, or resolution, of the instrument is often the only component of the total measurement uncertainty noted when reporting results. To address this shortfall, a measurement uncertainty analysis method was developed that includes the leak detector unit's resolution, repeatability, hysteresis, and drift, along with the uncertainty associated with the calibration standard. In a step-wise process, the method identifies the bias and precision components of the calibration standard, the measurement correction factor (K-factor), and the leak detector unit. Together these individual contributions to error are combined and the total measurement uncertainty is determined using the root-sum-square method. It was found that the precision component contributes more to the total uncertainty than the bias component, but the bias component is not insignificant. For helium mass spectrometer leak rate tests where unit sensitivity alone is not enough, a thorough evaluation of the measurement uncertainty such as the one presented herein should be performed and reported along with the leak rate value.

error analysis↗

Thermal Conductivity Based on Modified Laser Flash Measurement

The laser flash method is a standard method for thermal diffusivity measurement. It employs single-pulse heating of one side of a thin specimen and measures the temperature response of the other side. The thermal diffusivity of the specimen can be obtained based on a one-dimensional transient heat transfer analysis. This paper reports the development of a theory that includes a transparent reference layer with known thermal property attached to the back of sample. With the inclusion of heat conduction from the sample to the reference layer in the theoretical analysis, the thermal conductivity and thermal diffusivity of sample can be extracted from the temperature response data. Furthermore, a procedure is established to select two points from the data to calculate these properties. The uncertainty analysis indicates that this method can be used with acceptable levels of uncertainty.

Lin, Bochuan↗

HEU Metal Delayed Critical Experiments with 10 to 19 Inch Thick Graphite Reflectors

Approximately 100 graphite-reflected highly enriched uranium (HEU, 93.14 wt % 235 U) metal annular and cylindrical critical experiments were performed in the early 1960s at the Oak Ridge Critical Experiments Facility (ORCEF). This report presents details from experiment logbooks, experimental data sheets and the author's memory for 44 HEU metal (93.14 wt % 235 U) critical assemblies with graphite reflectors varying from 10 to 19 in. thick, outside diameters varying from 7 to 15 in., inside diameters varying from 7 to 13 in. and critical HEU metal masses varying from 20.4 to 69.0 kg. The data from the 44 experiments described in this report are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Evaluation Program (ICSBEP) once the uncertainty analysis on the measured k eff is completed. Based on previous ICSBEP benchmarks with this HEU metal at ORCEF, the uncertainties in the measured k eff are expected to be as low as ±0.0004. Preparation of this report is part of an effort at Oak Ridge National Laboratory (ORNL) to document more than 15 undocumented series of critical and subcritical experiments enumerated in Critical and Subcritical NEA Benchmark Possibilities for Measurements at ORCEF and Other US DOE Facilities (Mihalzo, ORNL/TM-2019/1188, 2019) and performed by ORNL at ORCEF and other US Department of Energy critical experiments facilities. More than 500 operational days of critical facility time were used, not including setup and dismantlement time. This documentation for a part of one series of graphite reflected highly enriched uranium metal critical experiments, that used 50 operational days of ORCEF time, was performed using funding received from the DOE Office of Nuclear Energy’s Nuclear Energy University Programs at the University of Tennessee Nuclear Engineering Department. This documentation was also supported by the Nuclear Criticality, Radiation Transport, and Safety programs at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗