Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Probabilistic Assessment and Uncertainty Analysis of CO2 Storage Capacity of the Morrow B Sandstone—Farnsworth Field Unit

This paper presents probabilistic methods to estimate the quantity of carbon dioxide (CO2) that can be stored in a mature oil reservoir and analyzes the uncertainties associated with the estimation. This work uses data from the Farnsworth Field Unit (FWU), Ochiltree County, Texas, which is currently undergoing a tertiary recovery process. The input parameters are determined from seismic, core, and fluid analyses. The results of the estimation of the CO2 storage capacity of the reservoir are presented with both expectation curve and log probability plot. The expectation curve provides a range of possible outcomes such as the P90, P50, and P10. The deterministic value is calculated as the statistical mean of the storage capacity. The coefficient of variation and the uncertainty index, P10/P90, is used to analyze the overall uncertainty of the estimations. A relative impact plot is developed to analyze the sensitivity of the input parameters towards the total uncertainty and compared with Monte Carlo. In comparison to the Monte Carlo method, the results are practically the same. The probabilistic technique presented in this paper can be applied in different geological settings as well as other engineering applications.

03 NATURAL GAS↗
NASA NTRS1991

Assessing damping uncertainty in space structures with fuzzy sets

NASA has been interested in the development of methods for evaluating the predictive accuracy of structural dynamic models. This interest stems from the use of mathematical models in evaluating the structural integrity of all spacecraft prior to flight. Space structures are often too large and too weak to be tested fully assembled in a ground test lab. The predictive accuracy of a model depends on the nature and extent of its experimental verification. The further the test conditions depart from in-service conditions, the less accurate the model will be. Structural damping is known to be one source of uncertainty in models. The uncertainty in damping is explored in order to evaluate the accuracy of dynamic models. A simple mass-spring-dashpot system is used to illustrate a comparison among three methods for propagating uncertainty in structural dynamics models: the First Order Method, the Numerical Simulation Method, and the Fuzzy Set Method. The Fuzzy Set Method is shown to bound the range of possible responses and thus to provide a valuable limiting check on the First Order Method near resonant conditions. Fuzzy Methods are a relative inexpensive alternative to numerical simulation.

Ross, Timothy J.↗
NASA NTRS2009

Assessing the Uncertainty of Land Surface Fluxes Derived from Operational Analyses

Operational numerical weather prediction systems assimilate tremendous amounts of observations to produce global analyses of the atmospheric states. Since the systems include significant contributions from the model components, physical fields, such as the turbulent heat fluxes, can also be derived. However, the physical fields are indirectly constrained by the data assimilation, and so subject to uncertainty in the model parameterizations. Recently, 10 international operational analyses have been collected and reprocessed through the Coordinated Enhanced. Observing Period (CEOP). Comparisons against independent observations (global precipitation and outgoing longwave radiation) show that while there is significant range of the individual analyses, the ensemble of analyses provide data closest the observations. Here, we evaluate the collection of land surface turbulent heat fluxes. The data are available for Oct 2002 - Dec 2004, at 6 hourly, daily and monthly intervals. An ensemble mean and its variance have been computed. we will analyze the range of analysis results at daily and seasonal time scales, and where possible compare with existing observations.

Bosilovich, Michael G.↗
NASA NTRS2016

Progress of Aircraft System Noise Assessment with Uncertainty Quantification for the Environmentally Responsible Aviation Project

Aircraft system noise predictions have been performed for NASA modeled hybrid wing body aircraft advanced concepts with 2025 entry-into-service technology assumptions. The system noise predictions developed over a period from 2009 to 2016 as a result of improved modeling of the aircraft concepts, design changes, technology development, flight path modeling, and the use of extensive integrated system level experimental data. In addition, the system noise prediction models and process have been improved in many ways. An additional process is developed here for quantifying the uncertainty with a 95% confidence level. This uncertainty applies only to the aircraft system noise prediction process. For three points in time during this period, the vehicle designs, technologies, and noise prediction process are documented. For each of the three predictions, and with the information available at each of those points in time, the uncertainty is quantified using the direct Monte Carlo method with 10,000 simulations. For the prediction of cumulative noise of an advanced aircraft at the conceptual level of design, the total uncertainty band has been reduced from 12.2 to 9.6 EPNL dB. A value of 3.6 EPNL dB is proposed as the lower limit of uncertainty possible for the cumulative system noise prediction of an advanced aircraft concept.

Thomas, Russell H.↗
NASA NTRSDate not supplied

Techniques in Assessing Random Uncertainty of Wind Tunnel Replicate Test Data

The preferred method to determine the random uncertainty of variables of interest during wind tunnel tests is by direct analysis of replicate data. However, current information is limited to analysis of a single replicate set condition that does not consider data covariance. This paper provides additional information on considerations for quantifying random uncertainty including the evaluation and correction of replicate data covariance, the selection of replicate set conditions for the test, and the interpolation of random uncertainty at other than replicate set conditions. The analysis and techniques are supported by data from a conventional aircraft configuration test at the Oran Nicks Low-Speed Wind Tunnel and an ASME nozzle flow characterization at the Propulsion Systems Laboratory.

Uncertainty↗
DOE OSTI2025

Numerical simulation of asteroid geometry variance on airburst threat

For an atmospheric airburst the primary source of concern when assessing uncertainty is the size and velocity. Determining these properties provides the basis for threat assessment, as the total energy of the asteroid may then be estimated, and the threat investigated thoroughly. Even with clarity as to how much energy an asteroid may deposit, a great deal of uncertainty still exists for the actual energy deposition process. One such source of uncertainty is the geometry of the incoming asteroid. The geometry of an asteroid will alter the stress distribution during entry, which adds uncertainty to when fracture will occur. Here, in this study, we use Smoothed Particle Hydrodynamics to model the atmospheric airburst of Tunguska-scale asteroids with varying geometric profiles, including a sphere, ellipsoid, binary and superellipsoid. Each asteroid is modeled as a homogenous structure with strength. We assess uncertainty through a series of planar 2D simulation cases for each geometry, comparing the source of stochasticity across geometries. A single 3D airburst simulation for each geometry is also analyzed. Additionally, the 3D cases are compared to the highly uncertain Tunguska event, predicting variance in burst height across geometries, but all bounded by theoretical burst heights proposed for Tunguska.

Airburst↗
NASA NTRS2023

Potentially Underestimated Gas Flaring Activities—A New Approach to Detect Combustion Using Machine Learning and NASA’s Black Marble Product Suite

Monitoring changes in greenhouse gas (GHG) emission is critical for assessing climate mitigation efforts towards the Paris Agreement goal. A crucial aspect of science-based GHG monitoring is to provide objective information for quality assurance and uncertainty assessment of the reported emissions. Emission estimates from combustion events (gas flaring and biomass burning) are often calculated based on activity data (AD) from satellite observations, such as those detected from the visible infrared imaging radiometer suite (VIIRS) onboard the Suomi-NPP and NOAA-20 satellites. These estimates are often incorporated into carbon models for calculating emissions and removals. Consequently, errors and uncertainties associated with AD propagate into these models and impact emission estimates. Deriving uncertainty of AD is therefore crucial for transparency of emission estimates but remains a challenge due to the lack of evaluation data or alternate estimates. This work proposes a new approach using machine learning (ML) for combustion detection from NASA's Black Marble product suite and explores the assessment of potential uncertainties through comparison with existing detections. We jointly characterize combustion using thermal and light emission signals, with the latter improving detection of probable weaker combustion with less distinct thermal signatures. Being methodologically independent, the differences in ML-derived estimates with existing approaches can indicate the potential uncertainties in detection. The approach was applied to detect gas flares over the Eagle Ford Shale, Texas. We analyzed the spatio-temporal variations in detections and found that approximately 79.04% and 72.14% of the light emission-based detections are missed by ML-derived detections from VIIRS thermal bands and existing datasets, respectively. This improvement in combustion detection and scope for uncertainty assessment is essential for comprehensive monitoring of resulting emissions and we discuss the steps for extending this globally.

gas flaring↗
DOE OSTI2024

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗
NASA NTRS2022

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗
DOE OSTI2025

The tensor-train stochastic finite volume method for uncertainty quantification

The stochastic finite volume method offers an efficient one-pass approach for assessing uncertainty in hyperbolic conservation laws. Still, it struggles with the curse of dimensionality when dealing with multiple stochastic variables. Here, we introduce the stochastic finite volume method within the tensor-train framework to counteract this limitation. This integration, however, comes with its own set of difficulties, mainly due to the propensity for shock formation in hyperbolic systems. To overcome these issues, we have developed a tensor-train-adapted stochastic finite volume method that employs a global WENO reconstruction, making it suitable for such complex systems. This approach represents the first step in designing tensor-train techniques for hyperbolic systems and conservation laws involving shocks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Controversy and consensus: common ground and best practices for life cycle assessment of emerging technologies

This manuscript explores six controversial topics regarding LCA of emerging technologies: (1) appropriate use of LCA, (2) uncertainty assessment, (3) comparison with incumbents, (4) adopting standards, (5) system scale-up, and (6) stakeholder engagement. These topics encompass key issues vigorously debated during a series of workshop-style discussions convened by the LCA of Emerging Technologies Research Network (currently hosted by ACLCA). This paper represents the main points of support and opposition for a declarative resolution representing each topic, along with points of consensus, held amongst research network of LCA practitioners and experts. These debates and associated open questions are intended to build awareness amongst practitioners and decision-makers of the common challenges associated with assessing emerging technologies, while fostering evidence-based and context-informed discussions that are both transparent and impactful for the broader community.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2018

(GO)2-SIM: a GCM-Oriented Ground-Observation Forward-Simulator Framework for Objective Evaluation of Cloud and Precipitation Phase

General circulation model (GCM) evaluation using ground-based observations is complicated by inconsistencies in hydrometeor and phase definitions. Here we describe (GO)2-SIM, a forward simulator designed for objective hydrometeor-phase evaluation, and assess its performance over the North Slope of Alaska using a 1-year GCM simulation. For uncertainty assessment, 18 empirical relationships are used to convert model grid-average hydrometeor (liquid and ice, cloud, and precipitation) water contents to zenith polarimetric micropulse lidar and Ka-band Doppler radar measurements, producing an ensemble of 576 forward-simulation realizations. Sensor limitations are represented in forward space to objectively remove from consideration model grid cells with undetectable hydrometeor mixing ratios, some of which may correspond to numerical noise.Phase classification in forward space is complicated by the inability of sensors to measure ice and liquid signals distinctly. However, signatures exist in lidar–radar space such that thresholds on observables can be objectively estimated and related to hydrometeor phase. The proposed phase-classification technique leads to misclassification in fewer than 8% of hydrometeor-containing grid cells. Such misclassifications arise because, while the radar is capable of detecting mixed-phase conditions, it can mistake water- for ice-dominated layers. However, applying the same classification algorithm to forward-simulated and observed fields should generate hydrometeor-phase statistics with similar uncertainty. Alternatively, choosing to disregard how sensors define hydrometeor phase leads to frequency of occurrence discrepancies of up to 40%. So, while hydrometeor-phase maps determined in forward space are very different from model "reality" they capture the information sensors can provide and thereby enable objective model evaluation.

Lamer, K.↗
NASA NTRS2012

Challenges of Sustaining the International Space Station through 2020 and Beyond: Including Epistemic Uncertainty in Reassessing Confidence Targets

This paper introduces an analytical approach, Probability and Confidence Trade-space (PACT), which can be used to assess uncertainty in International Space Station (ISS) hardware sparing necessary to extend the life of the vehicle. There are several key areas under consideration in this research. We investigate what sparing confidence targets may be reasonable to ensure vehicle survivability and for completion of science on the ISS. The results of the analysis will provide a methodological basis for reassessing vehicle subsystem confidence targets. An ongoing annual analysis currently compares the probability of existing spares exceeding the total expected unit demand of the Orbital Replacement Unit (ORU) in functional hierarchies approximating the vehicle subsystems. In cases where the functional hierarchies availability does not meet subsystem confidence targets, the current sparing analysis further identifies which ORUs may require additional spares to extend the life of the ISS. The resulting probability is dependent upon hardware reliability estimates. However, the ISS hardware fleet carries considerable epistemic uncertainty (uncertainty in the knowledge of the true hardware failure rate), which does not currently factor into the annual sparing analysis. The existing confidence targets may be conservative. This paper will also discuss how confidence targets may be relaxed based on the inclusion of epistemic uncertainty for each ORU. The paper will conclude with strengths and limitations for implementing the analytical approach in sustaining the ISS through end of life, 2020 and beyond.

Anderson, Leif↗
DOE OSTI2024

Uncertainties in greenhouse gas emission factors: A comprehensive analysis of switchgrass‐based biofuel production

Abstract This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass‐based biofuel production in Michigan. Using three life cycle assessment (LCA) databases—US lifecycle inventory (USLCI) database, GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI. The convergence of results across our previous study, static calculations, and Monte Carlo simulations enhances the credibility of estimated GWI values. Static calculations, validated by Monte Carlo simulations, offer reasonable central tendencies, providing a robust foundation for policy considerations. However, the wider range observed in Monte Carlo simulations underscores the importance of potential variations and uncertainties in real‐world applications. Sensitivity analyses identify biofuel yield, GHG emissions of electricity, and soil organic carbon (SOC) change as pivotal parameters influencing GWI. Decreasing uncertainties in GWI may be achieved by making greater efforts to acquire more precise data on these parameters. Our study emphasizes the significance of considering diverse GHG factors and databases in GWI assessments and stresses the need for accurate electricity fuel mixes, crucial information for refining GWI assessments and informing strategies for sustainable biofuel production.

Kim, Seungdo↗
DOE OSTI2024

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗
DOE OSTI2024

Modeling uncertainties in greenhouse gas (GHG) emission factors related to switchgrass-based biofuel production

This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass-based biofuel production in Michigan. Using three life cycle assessment (LCA) databases— US lifecycle inventory database (USLCI), GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI.

greenhouse ga emmission↗