Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

High Speed Testing of a High Efficiency Concentric Magnetic Gear

This presentation presents measurements of the efficiency of NASA's 2nd magnetic gear prototype. A detailed discussion of the test rig used to make these measurements was presented, including a thorough uncertainty analysis. The reported uncertainties are 95% confidence intervals that include the effects of temperature and parasitic loads. The prototype's response was measured at output speeds between 124 rpm and 744 rpm for a controlled output torque of 10 Nm (8% of the prototype's maximum torque). After correcting for tare losses, the prototype's efficiency was found to decrease from 90.0% to 83.0% as speed increased. If the efficiency is extrapolated to a typical operating condition (85% of maximum torque) using the good assumption that energy loss is approximately independent of the transmitted torque,the expected efficiency would be 99.0% to 98.4%, which exceeds the state of the art for these speeds.

Scheidler, Justin↗

Towards an Optimal Estimation Retrieval of Cirrus Cloud Optical and Microphysical Properties Using Hyperspectral Shortwave Instruments and A Fast Radiative Transfer Algorithm

Cirrus cloud retrieval products (here, cloud optical depth, effective particle size, and cloud top height) are important inputs into numerical weather and climate models. Uncertainties in such retrieval products, as a matter of course, propagate downstream, impacting model calculations. Improvements in high-quality global cirrus cloud optical and microphysical data products from satellite observations are needed to understand and reduce retrieval uncertainties. Hyperspectral shortwave instruments produce high-resolution and information-dense spectra, thus offering the opportunity to reduce uncertainties in retrieval products. We are in the process of developing a retrieval that uses the very fast Principal Component Radiative Transfer Model in the solar spectral region (PCRTM-Solar) in the forward model calculations. This retrieval will use measured reflectances from the NASA Earth Surface Mineral Dust Source Investigation (EMIT) and the forthcoming Climate Absolute Radiance and Refractivity Observatory Pathfinder (CLARREO-Pathfinder) instruments. In this manuscript we present progress towards a reference retrieval employing a widely used, verified, accurate, yet computationally slower radiative transfer modeling technique. The reference retrieval, while too slow for using the complete hyperspectral measurement, will allow us to study the behavior of retrieval products and help us verify results from our in-development fast retrieval. Both retrievals will use the optimal estimation retrieval framework. In this manuscript we present results from an uncertainty analysis considering three uncertainty sources for a cirrus cloud retrieval in the form of error covariance matrices: reflectance uncertainty due to water vapor, the reflectance uncertainty due to ice crystal scattering assumptions, and the instrument measurement uncertainty. Results show that the uncertainty due to habit selection is the largest, while that due to water vapor is at most 0.6% relative to channel reflectance. As a first step, the retrieval is being designed for single layer ice clouds over open ocean water.

Cirrus cloud↗

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

ASCoT 3: Nonlinear Principal Components Analysis and Uncertainty Quantification in Early Concept Spacecraft Flight Software Cost Estimation

For mission planners and evaluators alike, value in cost models comes from a mean or median prediction, an understanding of the uncertainty on that prediction, and an understanding of model performance. Here we apply advanced statistical and machine learning methods to spacecraft flight software cost, effort, and SLOC estimation, and present the results in the latest version of the Analogy Software Cost Tool (ASCoT). We present in- and out-of-sample performance metrics for our models, each of which incorporate some amount of epistemic uncertainty. ASCoT, hosted on the One NASA Cost Engineering (ONCE) database via the Online NASA Space Estimation Tool (ONSET), was first showcased in 2016 as a number of analogy-based models and methods (kNN and Clustering) to support early project formulation. This ASCoT update improves upon the previous analogic methods by incorporating uncertainty in the data transformations. In particular, we use a Nonlinear Principal Components Analysis (NLPCA) to deal with ordinal data.

Robotic Spacecraft↗

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

Lognormal Uncertainty Estimation for Failure Rates

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain. Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This presentation will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

TPSAS-NF1676L-17243-DND

This presentation captures ERA Project's effort in using integrated cost-schedule-risk analysis tool, identifying and capturing explicit relationships between program funds, schedule, and discrete risks. The project team merged a myriad of cost and schedule data for timely, objective, uncertainty analysis of the ITD's budget and schedule. The project team conducted detailed schedule uncertainty analysis showing schedule activities and how their interrelationships were impacted, representing an impressive advance beyond routine Gantt charts. Furthermore, the ERA Project collected discrete risk events including their impacts to costs and/or schedule and interwove these risks into cost and schedule logic networks, providing the foundation to conduct cost and schedule analyses. The team integrated this data into the analysis model, providing probabilistic results that were then used by the ERA Project's senior management for decision-making purposes. The ERA Project management team, through technical and pathfinder expertise in integrating cost, schedule, risk, and technical content, consistently provided risk-informed recommendations to Implementing Centers and ISRP senior management which ultimately ensured the successful ARMD Key Decision Point (KDP) review of the ERA Phase 2 ITD Portfolio and increased the likelihood of achieving technical objectives within cost and schedule constraints.

Gaudy M Bezos-O'Connor↗

Sensitivity Analysis and Uncertainty Quantification of a Mars Ascent Vehicle Concept

The design of a conceptual Mars ascent vehicle is a challenging problem. In order to aid the vehicle and mission concept design it is important to understand the driving design parameters and the expected performance in the presence of model errors and uncertainties. An existing six degree of freedom simulation model is analyzed on a statistical basis using the methods available in the Design Analysis Kit for Optimization and Terascale Applications toolkit. The methods utilized include conventional Monte Carlo techniques, metamodeling via polynomial chaos expansions, and global variance-based sensitivity analyses. Two additional analysis methods referred to as “Monte Carlo filtering” and ”Classification trees” are used to determine which uncertain parameters are driving the performance of the vehicle. Monte Carlo filtering provides a methodology to determine which parameters cause qualitatively different behavior while the classification trees use heuristics to partition the input space and assign probabilities to each partition. These methods serve as qualitative descriptors of model sensitivity while variance-based global sensitivity analysis seeks a quantitative mapping from total output variance to the variance of individual inputs. Application of these techniques to several outputs of a Mars ascent vehicle concept simulation indicates that only a select few input factors dominate their variance.

Noyes, Connor↗

Substructure Versus Property-Level Dispersed Modes Calculation

This paper calculates the effect of perturbed finite element mass and stiffness values on the eigenvectors and eigenvalues of the finite element model. The structure is perturbed in two ways: at the "subelement" level and at the material property level. In the subelement eigenvalue uncertainty analysis the mass and stiffness of each subelement is perturbed by a factor before being assembled into the global matrices. In the property-level eigenvalue uncertainty analysis all material density and stiffness parameters of the structure are perturbed modified prior to the eigenvalue analysis. The eigenvalue and eigenvector dispersions of each analysis (subelement and property-level) are also calculated using an analytical sensitivity approximation. Two structural models are used to compare these methods: a cantilevered beam model, and a model of the Space Launch System. For each structural model it is shown how well the analytical sensitivity modes approximate the exact modes when the uncertainties are applied at the subelement level and at the property level.

Stewart, Eric C.↗

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗

Environmental life cycle assessment methods applied to amine-ionic liquid hybrid CO 2 absorbents

A hybrid solvent mixture of triethyl(octyl)phosphonium cyanopyrrolide [P2228][2-CNPyr] and aqueous monoethanolamine (MEA) has the potential for absorbing CO 2 from post combustion flue gas. However, previous studies have found that the production of phosphonium based ionic liquids (IL) had significantly higher potential environmental impacts compared to MEA. Literature attributes these higher environmental impacts to the phosphine and phosgene-based intermediates required to produce the phosphonium ion of the ionic liquid. This study proposes a novel synthesis pathway that eliminates the need for phosphine and phosgene intermediates in the production of [P2228][2-CNPyr]. The environmental impacts of producing 1kg of the ionic liquid through this novel synthesis route was evaluated using the TRACI 2.1 methodology within the life cycle assessment (LCA) framework. Additionally, the environmental impacts for the production of 1kg of a hybrid solvent was also evaluated and compared against MEA. The life cycle inventory for the production of the IL and its hybrid solvent were calculated based on the stoichiometry and then scaled up. This study found that the IL and its hybrid solvents had higher environmental impacts among 9 of the 10 environmental impact categories calculated by the TRACI 2.1 methodology, except for the ecotoxicity potential. A sensitivity analysis indicated that these solvents were more sensitive to the assumptions of the material requirements of the phosphonium cation than the overall energy or transportation requirements. Despite this sensitivity, both the solvents demonstrated a lower Ecotoxicity Potential compared to MEA, the rest of the environmental impacts were still found to be higher than that of MEA, thereby underscoring the need to investigate novel synthesis routes for the production of phosphonium cation. The uncertainty analysis performed confirmed the findings that the IL has a higher environmental impact potentials across all categories except ecotoxicity potential. The uncertainty analysis also confirms that the phosphonium cation is a major hotspot in production route of these solvents and a source of uncertainty in the model compared to the anion. Altogether, this study underscores the need for investigating novel green chemistry pathway for the synthesis of phosphonium based ionic liquids, such as [P2228][2-CNPyr], to ensure that the these ILs can be a truly green alternative to MEA by not only offering superior CO₂ capture capacity compared to MEA but also being sustainably produced.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Comprehensive Analysis of Uncertainties in Warm-Rain Parameterizations in Climate Models Based on In Situ Measurements

Abstract Because of the coarse grid size of Earth system models (ESMs), representing warm-rain processes in ESMs is a challenging task involving multiple sources of uncertainty. Previous studies evaluated warm-rain parameterizations mainly according to their performance in emulating collision–coalescence rates for local droplet populations over a short period of a few seconds. The representativeness of these local process rates comes into question when applied in ESMs for grid sizes on the order of 100 km and time steps on the order of 20–30 min. We evaluate several widely used warm-rain parameterizations in ESM application scenarios. In the comparison of local and instantaneous autoconversion rates, the two parameterization schemes based on numerical fitting to stochastic collection equation (SCE) results perform best. However, because of Jessen’s inequality, their performance deteriorates when grid-mean, instead of locally resolved, cloud properties are used in their simulations. In contrast, the effect of Jessen’s inequality partly cancels the overestimation problem of two semianalytical schemes, leading to an improvement in the ESM-like comparison. In the assessment of uncertainty due to the large time step of ESMs, it is found that the rainwater tendency simulated by the SCE is roughly linear for time steps smaller than 10 min, but the nonlinearity effect becomes significant for larger time steps, leading to errors up to a factor of 4 for a time step of 20 min. After considering all uncertainties, the grid-mean and time-averaged rainwater tendency based on the parameterization schemes is mostly within a factor of 4 of the local benchmark results simulated by SCE.

Meteorology & Atmospheric Sciences↗

Monte Carlo analysis of uncertainty propagation in a stratospheric model. 1: Development of a concise stratospheric model

A concise model has been developed to analyze uncertainties in stratospheric perturbations, yet uses a minimum of computer time and is complete enough to represent the results of more complex models. The steady state model applies iteration to achieve coupling between interacting species. The species are determined from diffusion equations with appropriate sources and sinks. Diurnal effects due to chlorine nitrate formation are accounted for by analytic approximation. The model has been used to evaluate steady state perturbations due to injections of chlorine and NO(X).

Rundel, R. D.↗

Analysis of uncertainty in force balance calibration

In order to reduce errors encountered in the measurement and identification of loads using force balances, a third-order forward polynomial relation between loads and output voltages is proposed. This full third-order model represents an alternative to the second-order model currently in use at NASA Langley Research Center (LaRC) and many other installations worldwide. The new model requires the identification of 84 coefficients (including the 28 used presently) for each of the six outputs. The existing LaRC calibration loading sequence is insufficient for identification of many of these 504 coefficients because critical three-load combinations are absent. Accordingly, a new loading sequence that permits the identification of all 504 coefficients has been developed and is described fully. It is apparent from numerical tests that the new third-order model is clearly superior to second-order models in the presence of small amounts of random measurement noise, assuming that there are indeed higher-order interactions between loads. As the amount of noise increases, however, a third-order model becomes less attractive due to its ability to match the noise itself more faithfully than a second-order model. Numerical results suggest that the transition occurs when the magnitude of random noise becomes of the same order as that of the physical higher-order interactions.

Bursal, Faruk H.↗

Probabilistic Analysis of Uncertainty in ATRC Flux Profiles

ATRC is a replica of the larger ATR design and is used to conduct research and obtain data such as flux measurements, excess reactivity, and loading requirements before being loaded into ATR. One method for determining the impact an experiment will have at ATR is by looking at the axial flux profile along the fuel rod in the corresponding ATRC experiment; however, flux wand measurements includes large amounts of variation which makes drawing conclusions from the data difficult. This poster describes a definitive method to propagate the uncertainty from ATRC measurements using Python code.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗