Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Uncertainty Analysis of NASA Glenn's 8- by 6-Foot Supersonic Wind Tunnel

An analysis was performed to determine the measurement uncertainty of the Mach Number of the 8- by 6-foot Supersonic Wind Tunnel at the NASA Glenn Research Center. This paper details the analysis process used, including methods for handling limited data and complicated data correlations. Due to the complexity of the equations used, a Monte Carlo Method was utilized for this uncertainty analysis. A summary of the findings are presented as pertains to understanding what the uncertainties are, how they impact various research tests in the facility, and methods of reducing the uncertainties in the future.

uncertainty↗

LOFTID Aeroshell Thermal Response Uncertainty Analysis Utilizing the End-to-End Monte Carlo Approach

A probabilistic thermal margin process has been performed to design the flexible thermal protection system (FTPS) and select entry trajectory constraints given an acceptable risk level for the Low-Earth Orbit Flight Test of and Inflatable Decelerator (LOFTID) project. Uncertainties exist in atmospheric entry aeroheating environments and the predicted thermal response of thermal protection system (TPS) material. Entry vehicle TPS is often over-sized to mitigate uncertainty by combining conservative bounding scenarios together. The probabilistic thermal margin process allows engineers to make informed aeroshell design, flight design, and FTPS performance risk trades while preventing excessive FTPS margin from being applied. This paper describes the uncertainty analysis methodology used to carry out a probabilistic thermal margin process used for LOFTID’s aeroshell and explains how the calculated probability of exceeding flight allowable temperatures is used to design the FTPS and establish nominal flight design constraints. This probabilistic thermal margin process had never been applied to entry, decent, and landing design for a flown entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven Andrew Tobin↗

Uncertainty Analysis for Photovoltaic Degradation Rates (Poster)

Dependable and predictable energy production is the key to the long-term success of the PV industry. PV systems show over the lifetime of their exposure a gradual decline that depends on many different factors such as module technology, module type, mounting configuration, climate etc. When degradation rates are determined from continuous data the statistical uncertainty is easily calculated from the regression coefficients. However, total uncertainty that includes measurement uncertainty and instrumentation drift is far more difficult to determine. A Monte Carlo simulation approach was chosen to investigate a comprehensive uncertainty analysis. The most important effect for degradation rates is to avoid instrumentation that changes over time in the field. For instance, a drifting irradiance sensor, which can be achieved through regular calibration, can lead to a substantially erroneous degradation rates. However, the accuracy of the irradiance sensor has negligible impact on degradation rate uncertainty emphasizing that precision (relative accuracy) is more important than absolute accuracy.

14 SOLAR ENERGY↗

Dynamic wake prediction and visualization with uncertainty analysis

A dynamic wake avoidance system utilizes aircraft and atmospheric parameters readily available in flight to model and predict airborne wake vortices in real time. A novel combination of algorithms allows for a relatively simple yet robust wake model to be constructed based on information extracted from a broadcast. The system predicts the location and movement of the wake based on the nominal wake model and correspondingly performs an uncertainty analysis on the wake model to determine a wake hazard zone (no fly zone), which comprises a plurality of wake planes, each moving independently from another. The system selectively adjusts dimensions of each wake plane to minimize spatial and temporal uncertainty, thereby ensuring that the actual wake is within the wake hazard zone. The predicted wake hazard zone is communicated in real time directly to a user via a realistic visual representation. In an example, the wake hazard zone is visualized on a 3-D flight deck display to enable a pilot to visualize or see a neighboring aircraft as well as its wake. The system substantially enhances the pilot's situational awareness and allows for a further safe decrease in spacing, which could alleviate airport and airspace congestion.

Holforty, Wendy L.↗

Quantitative Uncertainty Analysis for Diffraction

Current software uses a least squares statistical method. For each model parameter, current software yields a point estimate and estimated standard error for each point estimate. In contrast, we have employed a Bayesian approach with sampling algorithm to provide a full posterior probability density function on each model parameter. This yields a different type of solution (probabilistic) with better fidelity. The Quantitative Uncertainty Analysis for Diffraction (QUAD) package returns a matrix of affect model parameters as a function of iteration through the MCMC analysis. QUAD is a Python code that allows for analysis of X-ray and neutron diffraction data to infer the structure of materials with quantifiable certainty. The code uses Bayesian statistics and Markov chain sampling algorithms to create posterior probability distributions on all material structure parameters that are modeled by a researcher. The statistical packages use the open source GSASII project as a library to calculate model diffraction patterns.

Fancher, ChristopherM↗

OECD/NEA expert group on uncertainty analysis for criticality safety assessment: Results of benchmark on sensitivity calculation (phase III)

The sensitivities of the k{sub eff} eigenvalue to neutron cross sections have become commonly used in similarity studies and as part of the validation algorithm for criticality safety assessments. To test calculations of the sensitivity coefficients, a benchmark study (Phase III) has been established by the OECD-NEA/WPNCS/EG UACSA (Expert Group on Uncertainty Analysis for Criticality Safety Assessment). This paper presents some sensitivity results generated by the benchmark participants using various computational tools based upon different computational methods: SCALE/TSUNAMI-3D and -1D, MONK, APOLLO2-MORET 5, DRAGON-SUSD3D and MMKKENO. The study demonstrates the performance of the tools. It also illustrates how model simplifications impact the sensitivity results and demonstrates the importance of 'implicit' (self-shielding) sensitivities. This work has been a useful step towards verification of the existing and developed sensitivity analysis methods. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncertainty Analysis for the Miniaturized Laser Heterodyne Radiometer (mini-LHR)

Presented here is a sensitivity analysis for the miniaturized laser heterodyne radiometer (mini-LHR). This passive, ground-based instrument measures carbon dioxide (CO2) in the atmospheric column and has been under development at NASA/GSFC since 2009. The goal of this development is to produce a low-cost, easily-deployable instrument that can extend current ground measurement networks in order to (1) validate column satellite observations, (2) provide coverage in regions of limited satellite observations, (3) target regions of interest such as thawing permafrost, and (4) support the continuity of a long-term climate record. In this paper an uncertainty analysis of the instrument performance is presented and compared with results from three sets of field measurements. The signal-to-noise ratio (SNR) and corresponding uncertainty for a single scan are calculated to be 329.4+/-1.3 by deploying error propagation through the equation governing the SNR. Reported is an absorbance noise of 0.0024 for 6 averaged scans of field data, for an instrument precision of approximately 0.2 ppmv for CO2.

carbon dioxide (CO2)↗

Modeling Molten Salt Spreading and Heat Transfer using MELTSPREAD – An Uncertainty Analysis

This report summarizes spreading and heat transfer results for molten salt pouring onto a flat stainless steel substrate that were calculated using MELTSPREAD to gain insight into bulk salt behavior during a molten salt spill accident. MELTSPREAD was developed at Argonne to model the one-dimensional flow and freezing behavior of molten corium and is being applied to model molten salts for the first time as part of this work. An uncertainty analysis of thermophysical properties and spill conditions was performed using MELTSPREAD to determine which properties and conditions have the greatest impact on model outcome. The model was run with and without the inclusion of decay heat. Eutectic FLiNaK was used as the salt composition because it is well-characterized and appropriate for model development. Small salt volumes were used for the initial model runs described in this report so that the model results can be compared to the results from ongoing experiments on molten salt spreading and heat transfer currently being conducted at Argonne at a benchtop scale. The spreading of a small volume of FLiNaK (50 mL) was found to be limited by the balance between the molten salt surface tension and gravity and not by freezing for the pour conditions and assumed mechanisms of heat transfer in the model. Heat transfer from the salt was highly inefficient to due to its low thermal conductivity, high heat capacity, and high heat of fusion and varying these properties had no effect on the spreading behavior. Changing the viscosity and density of the salt slightly affected the spreading behavior. Setting the salt surface tension to approximately zero to simulate the salt wetting the substrate had the greatest effect on the spreading behavior and this increased both the spreading velocity and overall spreading area. Including decay heat in the model had a significant effect on the long-term cooling behavior of the salt but had no effect on the overall spreading behavior. Future effort should involve modeling a larger volume of molten salt to represent a reactor case spill scenario because the spreading behavior of large volumes of salt may differ from the small volumes that were the focus of this document.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Analysis of the GeoNEX Top-of-Atmospheric Reflectance Products Generated from the Third-Generation Geostationary Satellite Sensors

The GeoNEX (Geostationary-NASA Earth eXchange) Level-1G products consist of top-of-atmosphere (TOA) bi-directional reflectance factor (BRF) and brightness temperature generated with data streams from the latest geostationary (GEO) sensors including GOES-16/17 ABI, Himawari-8/9 AHI, and GK-2A AMI on a global tiled common grid (60oN-60o and 180oW-180oE) in geographic coordinates. With their 16 spectral bands, 0.01o/0.02o nadir spatial resolution, and 10-minute temporal resolutions, these products provide exciting opportunity to monitor Earth surface processes. However, the unique Sun-Target-Satellite geometry of geostationary sensors demands special attention in analyzing/interpreting these datasets. In this study we present a systematic analysis on the relationship between the radiometric uncertainties of the GeoNEX TOA reflectance and the corresponding solar/satellite zenith angles. We show that the signal-to-noise ratio (SNR) of the BRF are positively proportional to the square roots of the cosine of solar illuminating zenith angles. That is, the BRF data are noisier earlier in the morning or later in the afternoon than in the mid of the day. The cosine of satellite viewing zenith angles do not directly influence the SNR of the TOA BRF. However, they positively regulate the relative importance of the surface component in the TOA BRF. This means that variations in surface reflectance are more difficult to detect for pixels with larger view zenith angles, even when the SNR of the TOA BRF is the same. We are developing metrics to specify such illumination-view geometry related uncertainties in the GeoNEX L1G TOA BRF products so that this key information can be easily accessed by the user community.

Geostationary satellite↗

SU-F-BRD-02: Incorporating Uncertainty Analysis in Plan Comparison of VMAT, Double Scattering Proton Plan and IMPT for Lung Irradiation

Purpose: We investigate the effect of residual setup and motion errors in lung irradiation for VMAT, double scattering (DS) proton beams and spot scanning (IMPT) in a case study. Methods: The CT image and contour sets of a lung patient treated with 6 MV VMAT is re-planned with DS as well as IMPT subject to the same constraints; V20(lung), V10(lung) and V5(lung)< 15%, 20% and 25% respectively, V20(heart)<25% and V100%(PTV)≥95%. In addition, uncertainty analysis in the form of isocenter shifts (±1–3mm) was incorporated in the DVH calculations to assess the plan robustness. Results: Only the IMPT plan satisfies all the specified constraints. The 3D-conformal DS proton plan is able to achieve better sparing of the lung and heart dose compared to VMAT. For the lung, V20, V10 and V5 are 13%, 19% and 25% respectively for IMPT, 18%, 23% and 30% respectively for DS, and 20%, 30% and 42% respectively for VMAT. For heart: 0.6% for IMPT, 2.4% for DS and 30% for VMAT. When incorporating isocenter shifts in DVH calculations, the maximum changes in V20, V10 and V5 for lung are 14%, 21% and 28% respectively for IMPT. The corresponding max changes are19%, 24% and 32% respectively for DS, and 22%, 32% and 44% respectively for VMAT. The largest change occurs in the PTV coverage. For IMPT, V100%(PTV) varies between 88–96%, while V100%(PTV) for VMAT suffers a larger change compared to DS (Δ=5.5% vs 3.3%). Conclusion: While only IMPT satisfies the stringent dose-volume constraints for the lung irradiation, it is not as robust as the 3D conformal DS plan. DS also has better sparing in lung and heart compared to VMAT and similar PTV coverage. By including isocenter shifts in dose-volume calculations in treatment planning of lung, DS appears to be more robust than VMAT.

60 APPLIED LIFE SCIENCES↗

Comprehensive Assessment of Global Surface Net Radiation Products and Uncertainty Analysis

Abstract Earth surface net radiation ( R n ) characterizes the surface radiation budget and plays a critical role in ecological, biogeochemical, and hydrological processes. The R n products from remote sensing and reanalysis have not been validated comprehensively. In this study, four R n products (Clouds and the Earth's Radiant Energy System [CERES], ERA‐Interim, Modern‐Era Retrospective analysis for Research and Applications version 2, and Japanese 55‐year Reanalysis) were validated using global ground measurements on monthly (255 sites) and annual (172 sites) timescales. These products have similar accuracies, with average root‐mean‐square error (RMSE) ranges of 5.35 W m −2 (monthly) and 2.30 W m −2 (annually). However, varying accuracies and systemic biases exist across different climatic zones. The annual land R n intercomparison illustrates that large uncertainty exists over polar regions and deserts. A significantly negative annual anomaly in the CERES product for the 2001–2008 period is identified when examining annual R n anomalies over the global land surface. Detailed uncertainty analysis indicates that the global CERES R n anomaly is mainly due to different versions of input data such as aerosol optical thickness and atmospheric profiles (in 2006 and 2008) and cloud properties (in 2002). This work demonstrates that temporal analysis provides powerful quality control for global time series satellite products when the validation using ground measurements fails to capture potential issues.

Jia, Aolin↗

A Monte Carlo Uncertainty Analysis of Ozone Trend Predictions in a Two Dimensional Model

We use Monte Carlo analysis to estimate the uncertainty in predictions of total O3 trends between 1979 and 1995 made by the Goddard Space Flight Center (GSFC) two-dimensional (2D) model of stratospheric photochemistry and dynamics. The uncertainty is caused by gas-phase chemical reaction rates, photolysis coefficients, and heterogeneous reaction parameters which are model inputs. The uncertainty represents a lower bound to the total model uncertainty assuming the input parameter uncertainties are characterized correctly. Each of the Monte Carlo runs was initialized in 1970 and integrated for 26 model years through the end of 1995. This was repeated 419 times using input parameter sets generated by Latin Hypercube Sampling. The standard deviation (a) of the Monte Carlo ensemble of total 03 trend predictions is used to quantify the model uncertainty. The 34% difference between the model trend in globally and annually averaged total O3 using nominal inputs and atmospheric trends calculated from Nimbus 7 and Meteor 3 total ozone mapping spectrometer (TOMS) version 7 data is less than the 46% calculated 1 (sigma), model uncertainty, so there is no significant difference between the modeled and observed trends. In the northern hemisphere midlatitude spring the modeled and observed total 03 trends differ by more than 1(sigma) but less than 2(sigma), which we refer to as marginal significance. We perform a multiple linear regression analysis of the runs which suggests that only a few of the model reactions contribute significantly to the variance in the model predictions. The lack of significance in these comparisons suggests that they are of questionable use as guides for continuing model development. Large model/measurement differences which are many multiples of the input parameter uncertainty are seen in the meridional gradients of the trend and the peak-to-peak variations in the trends over an annual cycle. These discrepancies unambiguously indicate model formulation problems and provide a measure of model performance which can be used in attempts to improve such models.

Considine, D. B.↗

Inverse modeling and uncertainty analysis of potential groundwater recharge to the confined semi-fossil Ohangwena II Aquifer, Namibia

The identification of potential recharge areas and estimation of recharge rates to the confined semi-fossil Ohangwena II Aquifer (KOH-2) is crucial for its future sustainable use. The KOH-2 is located within the endorheic transboundary Cuvelai-Etosha-Basin (CEB), shared by Angola and Namibia. The main objective was the development of a strategy to tackle the problem of data scarcity, which is a well-known problem in semi-arid regions. In a first step, conceptual geological cross sections were created to illustrate the possible geological setting of the system. Furthermore, groundwater travel times were estimated by simple hydraulic calculations. A two-dimensional numerical groundwater model was set up to analyze flow patterns and potential recharge zones. The model was optimized against local observations of hydraulic heads and groundwater age. The sensitivity of the model against different boundary conditions and internal structures was tested. Parameter uncertainty and recharge rates were estimated. Results indicate that groundwater recharge to the KOH-2 mainly occurs from the Angolan Highlands in the northeastern part of the CEB. The sensitivity of the groundwater model to different internal structures is relatively small in comparison to changing boundary conditions in the form of influent or effluent streams. Uncertainty analysis underlined previous results, indicating groundwater recharge originating from the Angolan Highlands. The estimated recharge rates are less than 1% of mean yearly precipitation, which are reasonable for semi-arid regions.

58 GEOSCIENCES↗

The IAEA Coordinated Research Program on HTGR Uncertainty Analysis: Phase I Status and Initial Results

The continued development of High Temperature Gas Cooled Reactors (HTGRs) requires verification of HTGR design and safety features with reliable high fidelity physics models and robust, efficient, and accurate codes. One way to address the uncertainties in the HTGR analysis tools is to assess the sensitivity of critical parameters (such as the calculated maximum fuel temperature during loss of coolant accidents) to a few important input uncertainties. The input parameters were identified by engineering judgement in the past but are today typically based on a Phenomena Identification Ranking Table (PIRT) process. The input parameters can also be derived from sensitivity studies and are then varied in the analysis to find a spread in the parameter of importance. However, there is often no easy way to compensate for these uncertainties. In engineering system design, a common approach for addressing performance uncertainties is to add compensating margins to the system, but with passive properties credited it is not so clear how to apply it in the case of modular HTGR heat removal path. Other more sophisticated uncertainty modelling approaches, including Monte Carlo analysis, have also been proposed and applied. Ideally one wishes to apply a more fundamental approach to determine the predictive capability and accuracies of coupled neutronics/thermal-hydraulics and depletion simulations used for reactor design and safety assessment. Today there is a broader acceptance of the use of uncertainty analysis even in safety studies, and it has been accepted by regulators in some cases to replace the traditional conservative analysis. Therefore some safety analysis calculations may use a mixture of these approaches for different parameters depending upon the particular requirements of the analysis problem involved. Sensitivity analysis can for example be used to provide information as part of an uncertainty analysis to determine best estimate plus uncertainty results to the required confidence level. In order to address uncertainty propagation in analysis and methods in the HTGR community the IAEA initiated a Coordinated Research Project (CRP) on the HTGR Uncertainty Analysis in Modelling (UAM) that officially started in 2013. Although this project focuses specifically on the peculiarities of HTGR designs and its simulation requirements, many lessons can be learned from the LWR community and the significant progress already made towards a consistent methodology uncertainty analysis. In the case of LWRs the NRC has already in 1988 amended 10 CFR 50.46 to allow best-estimate (plus uncertainties) calculations of emergency core cooling system performance. The Nuclear Energy Agency (NEA) of the Organization for Economic Co-operation and Development (OECD) also established an Expert Group on "Uncertainty Analysis in Modelling" which finally led to the definition of the "Benchmark for Uncertainty Analysis in Modelling (UAM) for Design, Operation and Safety Analysis of LWRs". The CRP on HTGR UAM will follow as far as possible the on-going OECD Light Water Reactor UAM benchmark activity.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Deploying Intra-hour Uncertainty Analysis Tools to ABB’s GridView - CRADA 445

The quickly-changing generation resource mix in the US grid, with large additions of variable resources, retirements of traditional thermal generation, distributed generation and demand response, are creating new challenges on the traditional operation of both the generation and transmission systems. The ability to perform intra-hour high fidelity production cost modeling (PCM) is needed to allow grid operators and grid planners to integrate high penetration (more than 50%) of variable energy resources, and to make prompt well informed decisions in market operations and planning. In the last decade, PNNL has developed several stand-alone tools to enable grid operators and planners to understand the impact of high variable generation on their systems. These tools have been used is studies such as: (1) Evaluation the benefits of WECC balancing authorities coordination under high variable generation penetration , (2) Benefits of Energy Imbalance Market in the North West Power Pool and (3) Duke Energy and NV Energy solar integration studies. ABB’s GridView is a widely used commercial PCM tool. It is the tool used by WECC and their stakeholders to develop the WECC PCM planning model on bi-annual basis. This proposal is focused on the integrating of PNNL intra-hour uncertainty analysis tools to GridView.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

Methods for System-Level Multidisciplinary Uncertainty Analysis of Low-Boom Flight Vehicles

Current research supporting NASA’s Commercial Supersonic Technology project is focused on the efficient prediction of uncertainty in sonic boom loudness generated by low-boom aircraft concepts. This paper focuses on research incorporating aircraft trim and aerostructural analysis into a multidisciplinary system-level uncertainty analysis. This enables the modeling of a steady-state representation of a point in the uncertainty space, simulating the vehicle as it would be flown. This approach also enables multiple uncertain parameters defining the configuration of the vehicle to be reduced to three: Mach number, altitude, and aircraft weight. To demonstrate this methodology, a case study exploring a conceptual low-boom supersonic aircraft is performed. Two different approaches are used to model the interactions between nearfield pressure signature analysis and sonic boom propagation, and their performance is evaluated in terms of accuracy and computational expense. One method uses a set of local surrogate models to generate a large number of nearfield signatures and perform Monte Carlo analysis. This method is found to produce, at a lower expense, uncertainty metrics that are comparable to the second method, in which uncertainty metrics are computed based on loudness metric values obtained directly from simulated nearfield signatures.

UQ↗