Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Uncertainty Analysis of Historical Hurricane Data

An analysis of variance (ANOVA) study was conducted for historical hurricane data dating back to 1851 that was obtained from the U. S. Department of Commerce National Oceanic and Atmospheric Administration (NOAA). The data set was chosen because it is a large, publicly available collection of information, exhibiting great variability which has made the forecasting of future states, from current and previous states, difficult. The availability of substantial, high-fidelity validation data, however, made for an excellent uncertainty assessment study. Several factors (independent variables) were identified from the data set, which could potentially influence the track and intensity of the storms. The values of these factors, along with the values of responses of interest (dependent variables) were extracted from the data base, and provided to a commercial software package for processing via the ANOVA technique. The primary goal of the study was to document the ANOVA modeling uncertainty and predictive errors in making predictions about hurricane location and intensity 24 to 120 hours beyond known conditions, as reported by the data set. A secondary goal was to expose the ANOVA technique to a broader community within NASA. The independent factors considered to have an influence on the hurricane track included the current and starting longitudes and latitudes (measured in degrees), and current and starting maximum sustained wind speeds (measured in knots), and the storm starting date, its current duration from its first appearance, and the current year fraction of each reading, all measured in years. The year fraction and starting date were included in order to attempt to account for long duration cyclic behaviors, such as seasonal weather patterns, and years in which the sea or atmosphere were unusually warm or cold. The effect of short duration weather patterns and ocean conditions could not be examined with the current data set. The responses analyzed were the storm latitude, longitude and intensity, as recorded in the data set, 24 or 120 hours beyond the current state. Several ANOVA modeling schemes were examined. Two forms of validation were used: 1) comparison with official hurricane prediction performance metrics and 2) cases studies conducted on hurricanes from the 2005 season, which were not included within the model construction and ANOVA assessment. In general, the ANOVA technique did not perform as well as the established official prediction performance metrics published by NOAA; still, the technique did remarkably well in this demonstration with a difficult data set and could probably be made to perform better with more knowledge of hurricane development and dynamics applied to the problem. The technique provides a repeatable prediction process that eliminates the need for judgment in the forecast.

Green, Lawrence L.↗

Modelling System Processes to Support Uncertainty Analysis and Robustness Evaluation

In the use of advanced systems control techniques in the development of a dynamic system, results from effective mathematical modelling is required. Historically, in some cases the use of a model which only reflects the "expected" or "nominal" important -information about the system's internal processes has resulted in acceptable system performance, but it should be recognized that for those cases success was due to a combination of the remarkable inherent potential of feedback control for robustness and fortuitously wide margins between system performance requirements and system performance capability. In the cases of a CELSS development, no such fortuitous combinations should be expected, and it should be expected that the uncertainty in the information on the system's processes will have to be taken into account in order to generate a performance robust design. In this paper, we develop one perspective of the issue of providing robustness as mathematical modelling impacts it, and present some examples of model formats which serve the needed purpose.

Blackwell, Charles↗

Status of the KRUSTY Benchmark Modeling and Uncertainty Analysis

The U.S. National Aeronautics and Space Administration’s (NASA) desire for a small nuclear reactor for space applications led to a prototype assembly, Kilopower Reactor Using Stirling Technology (KRUSTY). The KRUSTY experiments included four phases: component critical, cold critical, warm critical, and high temperature. The KRUSTY benchmark described in this paper includes five configurations from the component critical experiments that were performed at the National Criticality Experiments Research Center (NCERC) beginning in November 2017. Preliminary results have been reported. The benchmark is now nearing completion (although it is still preliminary until formally accepted by the International Criticality Safety Benchmark Evaluation Project [ICSBEP] working group). In this paper, we present the updated benchmark and its uncertainties. These results were computed using MCNP6.2 ® with ENDF/B-VIII.0 cross sections.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Antarctic Photochemistry: Uncertainty Analysis

Understanding the photochemistry of the Antarctic region is important for several reasons. Analysis of ice cores provides historical information on several species such as hydrogen peroxide and sulfur-bearing compounds. The former can potentially provide information on the history of oxidants in the troposphere and the latter may shed light on DMS-climate relationships. Extracting such information requires that we be able to model the photochemistry of the Antarctic troposphere and relate atmospheric concentrations to deposition rates and sequestration in the polar ice. This paper deals with one aspect of the uncertainty inherent in photochemical models of the high latitude troposphere: that arising from imprecision in the kinetic data used in the calculations. Such uncertainties in Antarctic models tend to be larger than those in models of mid to low latitude clean air. One reason is the lower temperatures which result in increased imprecision in kinetic data, assumed to be best characterized at 298K. Another is the inclusion of a DMS oxidation scheme in the present model. Many of the rates in this scheme are less precisely known than are rates in the standard chemistry used in many stratospheric and tropospheric models.

Stewart, Richard W.↗

Isokinetic TWC Evaporator Probe: Calculations and Systemic Uncertainty Analysis

A new Isokinetic Total Water Content Evaporator (IKP2) was downsized from a prototype instrument, specifically to make airborne measurements of hydrometeor total water content (TWC) in deep tropical convective clouds to assess the new ice crystal Appendix D icing envelope. The probe underwent numerous laboratory and wind tunnel investigations to ensure reliable operation under the difficult high altitude/speed/TWC conditions under which other TWC instruments have been known to either fail, or have unknown performance characteristics and the results are presented in a companion paper. This paper presents the equations used to determine the total water content (TWC) of the sampled atmosphere from the values measured by the IKP2 or necessary ancillary data from other instruments. The uncertainty in the final TWC is determined by propagating the uncertainty in the measured values through the calculations to the final result. Two techniques were used and the results compared. The first is a typical analytical method of propagating uncertainty and the second performs a Monte Carlo simulation. The results are very similar with differences that are insignificant for practical purposes. The uncertainty is between 2 percent and 3 percent at most practical operating conditions. The capture efficiency of the IKP2 was also examined based on a computational fluid dynamic simulation of the original IKP and scaled down to the IKP2. Particles above 24 microns were found to have a capture efficiency greater than 99 percent at all operating conditions.

Aircraft Icing↗

The two-dimensional diagnostic model for tropospheric OH - An uncertainty analysis

Tropospheric OH is believed to play a major role in atmospheric photochemistry, and, via its chemical interactions OH ultimately may affect the climate, stratospheric ozone levels, and the pH of rain. A valuable tool for predicting the global OH abundance as a function of latitude and altitude is the two-dimensional diagnostic model for tropospheric OH. This model can also be applied to budget studies of species which interact with OH, such as CH4, CO, and O3. In addition to laboratory-obtained kinetic data, important variables include the rate constants for several reactions, the rate of heterogeneous removal of soluble species, and the global abundance and spatial variability in H2O, O3, CO, and NOx. The uncertainties in these parameters imply over a factor of 3 variability in the calculated global OH concentration as well as significant uncertainties in the latitudinal and vertical OH distribution.

Chameides, W. L.↗

Isokinetic TWC Evaporator Probe: Calculations and Systemic Uncertainty Analysis

A new Isokinetic Total Water Content Evaporator (IKP2) was downsized from a prototype instrument, specifically to make airborne measurements of hydrometeor total water content (TWC) in deep tropical convective clouds to assess the new ice crystal Appendix D icing envelope. The probe underwent numerous laboratory and wind tunnel investigations to ensure reliable operation under the difficult high altitude/speed/TWC conditions under which other TWC instruments have been known to either fail, or have unknown performance characteristics and the results are presented in a companion paper (Ref. 1). This paper presents the equations used to determine the total water content (TWC) of the sampled atmosphere from the values measured by the IKP2 or necessary ancillary data from other instruments. The uncertainty in the final TWC is determined by propagating the uncertainty in the measured values through the calculations to the final result. Two techniques were used and the results compared. The first is a typical analytical method of propagating uncertainty and the second performs a Monte Carlo simulation. The results are very similar with differences that are insignificant for practical purposes. The uncertainty is between 2 and 3 percent at most practical operating conditions. The capture efficiency of the IKP2 was also examined based on a computational fluid dynamic simulation of the original IKP and scaled down to the IKP2. Particles above 24 micrometers were found to have a capture efficiency greater than 99 percent at all operating conditions.

Meteorological Instrument↗

PACE OCI Short-Wave Infrared Detection Assembly frequency-dependent linearity characterization and uncertainty analysis

The Ocean Color Instrument (OCI), the primary payload of the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE)observatory, will collect data to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared(SWIR) Detection Assembly (SDA) was built and characterized by the Utah State University Space DynamicsLaboratory (SDL) and is a subsystem of OCI. The SDA measures seven bands centered at 940, 1038, 1250, 1378,1615, 2130, and 2260 nm, with standard- and high-gain varieties for the 1250 and 1615 nm bands, resulting in nine total detection configurations in the SWIR. The delivery of high-quality science data is critically dependent upon accurately characterizing the linearity of the SDA. Two metrology techniques were employed to measure the linearity and characterize the frequency-dependent linearity uncertainty of the system. The first technique used superposition linearity measurements to determine the DC linearity, and the second technique involved an oscillating small-signal response at seven frequencies to determine the frequency-dependent linearity. Discrepancies between the DC and frequency-dependent linearities constrain the uncertainty between the two. Examining the difference between these two methods for all SDA channels, we find most channels experience an uncertainty below0.2% with a worst-case measurement uncertainty of 0.31%. Averaging SDA channels with similar detectors, optical filters, and electronics to simulate the flight-like data products yields a worst-case frequency-dependence linearity uncertainty of 0.12%, demonstrating minimal frequency dependence, implying an excellent linearity knowledge.Detailed performance knowledge, including linearity performance, verifies data quality and builds confidence in the success of the PACE mission.

PACE↗

Uncertainty Analysis for a Criticality Benchmark [Slides]

This presentation discusses how KRUSTY was analyzed with LANL’s MCNP neutron transport code, Monte Carlo N-Particle. In the Monte Carlo method, neutrons are born in fission events and fly around the geometry having events (e.g., scatter, capture, fission, escape) according to the natural probabilities. “Natural probabilities” are given as neutron cross sections , which are measured and evaluated nuclear data. One of the goals of the benchmark project is to improve the nuclear cross sections (and the codes that use them). In this work, the response of interest is called k eff , which describes the neutron multiplication in a near critical system. Like most quantities, k eff is not measured directly; it is only inferred. In summation, MCNP results for k eff matched the measurements extremely well. The evaluated uncertainties are asymmetric and smaller than 0.00100 (e.g., + 0.00080 / – 0.00062). The largest uncertainties are due to alignment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Analysis for a Criticality Benchmark [Slides]

This presentation discusses how KRUSTY was analyzed with LANL’s MCNP neutron transport code, Monte Carlo N-Particle. In the Monte Carlo method, neutrons are born in fission events and fly around the geometry having events (e.g., scatter, capture, fission, escape) according to the natural probabilities. “Natural probabilities” are given as neutron cross sections , which are measured and evaluated nuclear data. One of the goals of the benchmark project is to improve the nuclear cross sections (and the codes that use them). In this work, the response of interest is called k eff , which describes the neutron multiplication in a near critical system. Like most quantities, k eff is not measured directly; it is only inferred. In summation, MCNP results for k eff matched the measurements extremely well. The evaluated uncertainties are asymmetric and smaller than 0.00100 (e.g., + 0.00080 / – 0.00062). The largest uncertainties are due to alignment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Shock initiation of the HMX-based explosive PBX 9012: Experiments, uncertainty analysis, and unreacted equation-of-state

In this study, shock initiation experiments have been carried out on the polymer-bonded explosive PBX 9012 [nominally 90% octahydro-1,3,5,7-tetranitro-1,3,5,7-tetrazine (HMX), 10% vinylidene–hexafluoropropylene copolymer (Viton A) by weight] in order to provide calibration data for the explosive’s unreacted equation-of-state (EOS) and shock-to-detonation transition for reactive burn rate calibration. The input pressures covered the range of 1.86–4.43 GPa. This provided run-to-detonation depths ranging from > 22.3 mm for the lowest pressure shot to 4.91 mm at the highest pressure. The relative shock sensitivity of PBX 9012 is compared to other HMX-explosives in terms of the Pop-plot, showing that the studied explosive is more sensitive than other similar HMX-based counterparts (with notable exceptions). The uncertainty in the shock velocity determinations from the shock tracker measurements are also investigated, yielding new uncertainty measures in the generated Hugoniot data and run-to-detonation coordinates. Finally, the unreacted equation-of-state is determined using a linear U s – u p Mie–Grüneisen relation and the Davis reactants EOS analytical form, the latter being more suited for reactive burn modeling.

36 MATERIALS SCIENCE↗

Uncertainty analysis of Raman spectra for measuring ortho-parahydrogen compositions

Determining ortho-parahydrogen compositions at cryogenic temperatures is an important quality control for liquid hydrogen custody exchange. High orthohydrogen compositions lead to an exothermic reaction resulting in increased boil off and increased venting losses of liquid hydrogen product by either the supplier or consumer. Traditional methods for measuring ortho-parahydrogen compositions such as hot-wire anemometry, nuclear magnetic resonance, and infrared spectroscopy are typically inconvenient at best. As the number of cryogenic hydrogen systems continue to increase, there is an increased need for flexible, standardized techniques for post processing composition measurements. A Raman spectrometer implemented in the Cryo-Catalysis Hydrogen Experimental Facility (CHEF) has demonstrated incredible flexibility for composition measurements of cryogenic hydrogen flows through a wide range of temperatures and pressures with the Raman probe in-situ at cryogenic temperatures. This article analyzes the uncertainty of Raman spectroscopy data of cryogenic hydrogen equilibrated at temperatures in IONEX catalyst. Spectra from hydrogen catalyzed to the equilibrium ortho-parahydrogen composition are processed and compared to expected statistical distributions for method verification.

08 HYDROGEN↗

REVIEW OF MECHANISTIC UNDERSTANDING AND MODELING AND UNCERTAINTY ANALYSIS METHODS FOR PREDICTING CEMENTITIOUS BARRIER PERFORMANCE

Cementitious barriers for nuclear applications are one of the primary controls for preventing or limiting radionuclide release into the environment. At the present time, performance and risk assessments do not fully incorporate the effectiveness of engineered barriers because the processes that influence performance are coupled and complicated. Better understanding the behavior of cementitious barriers is necessary to evaluate and improve the design of materials and structures used for radioactive waste containment, life extension of current nuclear facilities, and design of future nuclear facilities, including those needed for nuclear fuel storage and processing, nuclear power production and waste management. The focus of the Cementitious Barriers Partnership (CBP) literature review is to document the current level of knowledge with respect to: (1) mechanisms and processes that directly influence the performance of cementitious materials (2) methodologies for modeling the performance of these mechanisms and processes and (3) approaches to addressing and quantifying uncertainties associated with performance predictions. This will serve as an important reference document for the professional community responsible for the design and performance assessment of cementitious materials in nuclear applications. This review also provides a multi-disciplinary foundation for identification, research, development and demonstration of improvements in conceptual understanding, measurements and performance modeling that would be lead to significant reductions in the uncertainties and improved confidence in the estimating the long-term performance of cementitious materials in nuclear applications. This report identifies: (1) technology gaps that may be filled by the CBP project and also (2) information and computational methods that are in currently being applied in related fields but have not yet been incorporated into performance assessments of cementitious barriers. The various chapters contain both a description of the mechanism or and a discussion of the current approaches to modeling the phenomena.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Trajectory Reconstruction and Uncertainty Analysis Using Mars Science Laboratory Pre-Flight Scale Model Aeroballistic Testing

As part of the Mars Science Laboratory (MSL) trajectory reconstruction effort at NASA Langley Research Center, free-flight aeroballistic experiments of instrumented MSL scale models was conducted at Aberdeen Proving Ground in Maryland. The models carried an inertial measurement unit (IMU) and a flush air data system (FADS) similar to the MSL Entry Atmospheric Data System (MEADS) that provided data types similar to those from the MSL entry. Multiple sources of redundant data were available, including tracking radar and on-board magnetometers. These experimental data enabled the testing and validation of the various tools and methodologies that will be used for MSL trajectory reconstruction. The aerodynamic parameters Mach number, angle of attack, and sideslip angle were estimated using minimum variance with a priori to combine the pressure data and pre-flight computational fluid dynamics (CFD) data. Both linear and non-linear pressure model terms were also estimated for each pressure transducer as a measure of the errors introduced by CFD and transducer calibration. Parameter uncertainties were estimated using a "consider parameters" approach.

Lugo, Rafael A.↗

Uncertainty Analysis for Oil-Film Interferometry Skin-Friction Measurement Techniques

Over the past 20 years, the use of oil-film interferometry to measure the skin friction coefficient (C(sub f) = tau/q where tau is the surface shear stress and q is the dynamic pressure) has increased. Different forms of this oil-film technique with various levels of accuracy and ease of use have been successfully applied in a wide range of flows. The method's popularity is growing due to its relative ease of implementation and minimal intrusiveness as well as an increased demand for C(sub f) measurements. Nonetheless, the accuracy of these methods has not been rigorously addressed to date. Most researchers have simply shown that the skin-friction measurements made using these techniques compare favorably with other measurements and theory, most of which are only accurate to within 5-20%. The use of skin-friction data in the design of commercial aircraft, whose drag at cruise is 50% skin-friction drag, and in the validation of computational fluid dynamics programs warrants better uncertainty estimates. Additional information is contained in the original extended abstract.

Naughton, Jonathan W.↗

Mineral dissolution and precipitation during CO 2 injection at the Frio-I Brine Pilot: Geochemical modeling and uncertainty analysis

During the Frio-I Brine Pilot CO 2 injection experiment in 2004, distinct geochemical changes in response to the injection of 1600 tons of CO 2 were recorded in samples collected from the monitoring well. Previous geochemical modeling studies have considered dissolution of calcite and iron oxyhydroxides, or release of adsorbed iron, as the most likely sources of the increased ion concentrations. We explore in this modeling study possible alternative sources of the increasing calcium and iron, based on the data from the detailed petrographic characterization of the Upper Frio Formation “C”. Particularly, we evaluate whether dissolution of pyrite and oligoclase (anorthite component) can account for the observed geochemical changes. Due to kinetic limitations, dissolution of pyrite and anorthite cannot account for the increased iron and calcium concentrations on the time scale of the field test (10 days). However, dissolution of these minerals is contributing to carbonate and clay mineral precipitation on the longer time scales (1000 years). The one-dimensional reactive transport model predicts carbonate minerals, dolomite and ankerite, as well as clay minerals kaolinite, nontronite and montmorillonite, will precipitate in the Frio Formation “C” sandstone as the system progresses towards chemical equilibrium during a 1000-year period. Cumulative uncertainties associated with using different thermodynamic databases, activity correction models (Pitzer vs. B-dot), and extrapolating to reservoir temperature, are manifested in the difference in the predicted mineral phases. Furthermore, these models are consistent with regards to the total volume of mineral precipitation and porosity values which are predicted to within 0.002%.

54 ENVIRONMENTAL SCIENCES↗

Radiative Heating Indicators and Uncertainty Analysis for Mars 2020

This paper will present analysis to evaluate a functional form and associated parameters to determine the radiative heating at various back-shell locations of the Mars 2020 aeroshell. The radiative heating indicators are used for preliminary vehicle design, and to determine the worst-case trajectories for peak radiative heat flux and load. Historically, the functional form for radiative heating is based on free-stream parameters of density, velocity and a length scale, typically the nose-radius (or equivalent). However, a fit of this form has been shown to not provide significant enough accuracy when compared to simulation results. Therefore, a fit based on post-shock equilibrium calculations of CO and CO2 number density, temperature and pressure has been devised. The results from the TPS 15 01 trajectory were used to develop the fit. The fit was then applied to the MSL best estimated trajectory (BET). Furthermore, the paper will quantify the uncertainty in simulations of the radiative heating for Mars 2020.

Mars 2020↗

Coherent Uncertainty Analysis of Aerosol Measurements from Multiple Satellite Sensors

Aerosol retrievals from multiple spaceborne sensors, including MODIS (on Terra and Aqua), MISR, OMI, POLDER, CALIOP, and SeaWiFS altogether, a total of 11 different aerosol products were comparatively analyzed using data collocated with ground-based aerosol observations from the Aerosol Robotic Network (AERONET) stations within the Multi-sensor Aerosol Products Sampling System (MAPSS, http://giovanni.gsfc.nasa.gov/mapss/ and http://giovanni.gsfc.nasa.gov/aerostat/). The analysis was performed by comparing quality-screened satellite aerosol optical depth or thickness (AOD or AOT) retrievals during 2006-2010 to available collocated AERONET measurements globally, regionally, and seasonally, and deriving a number of statistical measures of accuracy. We used a robust statistical approach to detect and remove possible outliers in the collocated data that can bias the results of the analysis. Overall, the proportion of outliers in each of the quality-screened AOD products was within 12%. Squared correlation coefficient (R2) values of the satellite AOD retrievals relative to AERONET exceeded 0.6, with R2 for most of the products exceeding 0.7 over land and 0.8 over ocean. Root mean square error (RMSE) values for most of the AOD products were within 0.15 over land and 0.09 over ocean. We have been able to generate global maps showing regions where the different products present advantages over the others, as well as the relative performance of each product over different landcover types. It was observed that while MODIS, MISR, and SeaWiFS provide accurate retrievals over most of the landcover types, multi-angle capabilities make MISR the only sensor to retrieve reliable AOD over barren and snow / ice surfaces. Likewise, active sensing enables CALIOP to retrieve aerosol properties over bright-surface shrublands more accurately than the other sensors, while POLDER, which is the only one of the sensors capable of measuring polarized aerosols, outperforms other sensors in certain smoke-dominated regions, including broadleaf evergreens in Brazil and South-East Asia.

remote sensing↗