Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Visualization and Decision Making Design Under Uncertainty

This report documents the program and the outcomes of Dagstuhl Seminar 22331 "Visualization and Decision Making Design Under Uncertainty". The seminar brought together 33 researchers and practitioners from different domains concerned with visualization and decision making under uncertainty including visualization, visual analytics, human-computer interaction, artificial intelligence, climate research, geography and geology. The programme was organized in two parts: In the first part which lasted two days, participants gave short talks where they discussed current practices and the uncertainty visualization challenges they encountered in their own research. At the end of day two, participants brainstormed collectively around the main uncertainty visualization research challenges across domains and applications. In the second part, participants voted for the following three main challenges they wished to discuss for the remainder of the seminar (one and a half days): applications, human-centered uncertainty visualization, a design process for uncertainty visualization. Thus three break-out groups were formed to discuss these challenges. Abstracts for the individual talks and the break-out group activities are included in this report.

decision making↗
NASA NTRS2018

Combined Error and Uncertainty Estimates for CFD Problems

Given input sources of uncertainty, non-intrusive uncertainty propagation methods quantify the uncertainty in output quantities of interest (QoI) by performing a nite number of CFD (Computational Fluid Dynamics) instance realizations needed in the calculation of output statistics. It is well known that this introduces multiple sources of error. CFD codes often utilize finite-dimensional approximation (grids, basis functions, etc.) thus incurring CFD numerical errors often approximately reinterpreted as a statistical bias. Uncertainty propagation methods calculate uncertainty statistics for output quantities of interest using a numerical method (e.g. deterministic quadrature, sampling, etc.) thus incurring UQ (Uncertainty Quantification) numerical errors. Importance of quantifying these errors in large scale scientific computing: How accurate is an output statistic?; How should additional computational resources be invested to further reduce the error in a statistic?

Posteriori↗
NASA NTRS2018

Determination of Uncertainties for Analytically Derived Material Properties to Be Used in Monte Carlo Based Orion Heatshield Sizing

Ablative materials are often used for spacecraft heatshields to protect underlying structures from the extreme environments associated with atmospheric reentry. NASA's Orion EM-1 capsule has been designed to use a molded Avcoat material system. In order to determine the required heatshield thickness, a Monte Carlo approach to the sizing process was proposed. To perform the Monte Carlo simulation, statistical uncertainties on all material property input parameters were required. Obtaining these values for measured properties is straightforward, however input parameters that are derived analytically have historically used uncertainties based on engineering judgment. A MATLAB program was created to use laboratory generated thermogravimetric analysis (TGA) data to calculate uncertainties on the Arrhenius parameters for molded Avcoat. Uncertainties associated with the normalized ablation rate and pyrolysis gas enthalpy were also generated using a wrapper script and the ACE code. These uncertainties could then be tied directly to measured values of individual elemental constituents. The resulting uncertainty values will allow for a probabilistic sizing approach on molded Avcoat with a higher level of confidence in the input parameters.

material property uncertainties↗
NASA NTRS2020

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗
NASA NTRS2022

Low-Earth Orbit Trajectory Optimization in the Presence of Atmospheric Uncertainty

The previous 20 to 25 years have seen a tremendous increase in space exploration, and with that an increase in the level of logistics planning needed to ensure mission success. For spacecraft that are designed to be periodically re-supplied, a key logistics consumable is propellant, as it constitutes the greatest up-mass on re-supply vehicles. A trajectory design strategy is therefore desired that minimizes propellant usage in order to ease the demand for propellant re-supply missions. This thesis develops such a strategy in three stages, and uses the International Space Station (ISS) as its testbed, as no other LEO spacecraft is more challenging from a space logistics standpoint. First, the ISS trajectory planning problem is formulated as a constrained burn optimization problem assuming a deterministic atmosphere. The cost function is total ∆v, with constraints imposed on longitude of ascending viii node (LAN) and semi-major axis (SMA) altitude. Analytic derivatives are constructed for both the cost and constraints, which are necessary given the 6-week to 2-year time frames being considered. A gradient-based optimizer is then utilized to find locally-optimal solutions to real-world ISS trajectory planning problems. Second, atmospheric uncertainty is addressed by constructing a probabilistic model of space weather data using Gaussian Processes (GPs). Bayesian inference is performed using the GP model to generate mean and covariance estimates for space weather predictions, whose pedigree is assessed against test data. The predictions are then mapped into atmospheric density via the analytic Jacchia-Roberts density model, and the effect of space weather uncertainty on orbital lifetime is examined. Third, an ISS burn execution uncertainty model is developed. This model, along with the space weather uncertainty model, are deployed in a linear covariance analysis to ascertain their combined effect on LAN and SMA altitude dispersions. The deterministic constraints from the original problem are re-formulated as stochastic constraints, where now the constraint uncertainty interval is required to fall within specified bounds. An updated optimization framework is constructed using the original ∆v cost function along with the stochastic constraints to solve the trajectory optimization problem under atmospheric uncertainty. Finally, the complete architecture is summarized for deployment in an operational setting.

Trajectory Optimization↗
NASA NTRS2023

Uncertainty Analysis of Slug Calorimeters in the HyMETS Arc-Jet Facility

The objective of this work is to perform an uncertainty analysis of the deduced stagnation heat flux environment on a slug calorimeter for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System arc-jet facility located at NASA Langley Research Center. Analytical solutions are developed for boundary-value problems on the slug element accounting for non-ideal effects, including spatial variation in the slug heat flux, multi-dimensional thermal conduction, and back-face losses, which departs from the state-of-the-art method derived from the American Society of Testing and Materials. Boundary-value problem definitions are informed by preliminary finite element thermal analysis of the slug calorimeter assembly (including both slug and housing) and just the slug element. The analytical solutions are presented in a general sense and in a truncated form from error analysis. Results are shown in optimizing and validating the analytical models against available slug back-face thermal data. The optimization results indicate that the appropriate epistemic uncertainty of the deduced stagnation heat flux on the slug calorimeter is at most±2.5% for both a high-and low-enthalpy test condition. In addition, a numerical approach is used to determine the aleatory (probabilistic) uncertainty component in the slug stagnation heat flux by applying a marching least-squares slope routine through the steady-state portion of the slug back-face thermal response. Results indicate a compromise between the number of samples and the filter frequency of slug back-face thermal data points when evaluating the standard deviation of the deduced stagnation heat flux statistics. When combining the mixed uncertainty, both aleatory and epistemic, the interval of uncertainty in the deduced stagnation heat flux is determined to be up to ±4%, which is at least a 60% reduction from the standard uncertainty used in the state-of-the-art method.

uncertainty↗
NASA NTRSDate not supplied

Effects of Natural Variability on the Use of Standard Deviation to Represent Measurement Uncertainties in Atmospheric Composition Studies

Measurement uncertainty is defined as a “non-negative parameter characterizing the dispersion of the quantity values being attributed to a measurand”. It is most common that the uncertainties of GAW hourly measurements, such as greenhouse gas measurements, are reported as standard deviations derived from individual sampling at a higher time resolution (e.g., 1 min). In contrast, the uncertainties of GAW measurements of reactive gases and aerosol properties are reported in percentiles covering the same probability. A quick look at hourly CO 2 data from Cape Grim, Australia yielded some interesting findings: the hourly standard deviation is, on average, more than a factor of 10 higher for the measurements under non-background conditions (over 50% observations), while the difference in average CO 2 amount fraction was less than 2 ppm. The dramatic contrast cannot be explained by the difference in measurement uncertainties, but can largely be attributed the natural variability, or episodic ambient CO 2 variation reflecting changes in meteorological conditions or emissions. These initial findings motivated a more in-depth analysis of the ground-based measurements of trace gases and aerosol properties. This analysis will be using continuous 1 min ground site observations to construct time averaged statistical indicators to evaluate whether the standard deviation is adequate to represent the dispersion, especially under marked influence by natural variability. The suitability of this representation can be determined by examining the difference between the standard deviation and percentiles encompassing the same probability. We will examine time intervals of 1 hour, 3 hours, and 24 hours, with the latter time intervals chosen to match those commonly used in model assessments. We will also investigate how natural variability can alter the probability distribution of the measurands and how adequate the quadrature propagation of uncertainties is under these conditions. The results will include several trace gases (e.g., CO 2 , CO, O 3 , and NO 2 ) with a range of measurement techniques (e.g., PANDORA, in situ), atmospheric lifetimes, and aerosol properties (e.g. scattering coefficient). The findings from this analysis should provide some useful feedback on the best practices for uncertainty reporting.

Measurement Uncertainty↗
DOE OSTI2021

Definitions for Testing Whether Evaluated Nuclear Data Relative Uncertainties are Realistic in Size

This document describes various tests that can be used to check whether evaluated relative uncertainties stored in nuclear-data covariances are realistic. To be more specific, these tests check whether nuclear-data uncertainties could be either over- or under-estimated given the input that usually enters the evaluation of nuclear-data mean values and covariances. Warning and error messages on the reliability of nuclear-data uncertainties will result from these tests. If uncertainties of one specific nuclear-data observable trigger warning messages from multiple tests, an evaluator should counter-check the reliability of the relative uncertainties of this particular nuclear-data covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

A Global Methane Observation System to Reduce Uncertainty for Anthropogenic and Natural Sources and Sinks for Detecting and Attributing Climate Feedbacks

Atmospheric methane (CH4) concentrations are accelerating global warming as net emissions increase. Observing systems that quantify sources remain too sparse and fragmented to detect trends—especially in remote regions where climate‐driven natural emissions may be rising. We provide a framework for quantifying uncertainty reductions through the implementation of a global ecosystem‐methane observing system designed to: (i) substantially lower uncertainty in sectoral and regional emissions, (ii) separate co‐occurring anthropogenic and natural fluxes, and (iii) trend detection at regional scales to verify mitigation progress and provide early warning of natural feedbacks. Using bottom‐up inventories and process‐model ensembles for 2014–2023, we show that anthropogenic emissions remain uncertain by ∼32% globally, while natural sources—tropical and boreal‐arctic wetlands, fires, and inland waters—carry far larger uncertainties (+ 70%) and trend uncertainties reaching ∼200%. Additional observations must match spatial emission structure to increase observability of emissions: high‐resolution satellite constellations for point sources combined with expanded flux networks and wetland mapping for diffuse sources, and denser ground‐based atmospheric column measurements to restore observability in under‐sampled tropics and high latitudes. Notional analyses indicate that targeted additions of flux towers and ∼20 in situ atmospheric column concentration instruments per key tropical region could reduce continental‐scale uncertainties at modest cost. Conceptual illustration of a Global Ecosystem Methane Observing System (GEM‐OS) integrating satellites, aircraft, atmospheric networks, and ecosystem measurements to quantify methane emissions from anthropogenic and natural sources. The multi‐scale observing framework improves source attribution, reduces uncertainty in regional methane budgets, and enables early detection of climate‐driven feedbacks from wetlands, fires, permafrost, agriculture, and fossil‐fuel emissions.

Ciais, P↗
DOE OSTI2021

Propagation of Input Uncertainties in Numerical Simulations of Laser Powder Bed Fusion

Laser powder bed fusion has the potential of redefining state-of-the-art processing and production methods, but defect formation and inconsistent build quality have limited the implementation of this process. Numerical models are widely used to study this process and predict the formation of these defects. Presently, the uncertainties of model input parameters and thermophysical properties used by these numerical simulations have not been investigated. In the present study, the uncertainty in these input parameters and material properties are quantified for laser powder bed fusion, with and without a simulated powder bed, to determine their influence on the predictive accuracy of an experimentally validated numerical model. Accounting for all possible sources of uncertainty quickly becomes computationally expensive on account of the curse of dimensionality. Uncertainty in laser absorption, solid, and liquid specific heat of the metal were found to have the largest effect on model prediction reliability with or without the use of a powder bed. Results also illustrate that accounting for these three uncertain parameters still captures the majority of model prediction uncertainty. Furthermore, the methodology of this study may be used to understand the uncertainty in as-built microstructure through propagation to microstructure prediction models, or applied under processing conditions where high Péclet numbers are observed and the thermal convection and fluid flow within the molten pool are substantial.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗
DOE OSTI2021

An Assessment of Global Positioning System Velocity Uncertainty in California

We analyze data from 580 continuous global positioning system (GPS) stations in California to quantify differences in published velocity estimates from five analysis centers. Horizontal and vertical rates for individual stations can differ up to 5 mm/yr, with systematic differences in some areas comparable to deformation rates. Published velocity uncertainties vary between analysis centers and are systematically underreported in the horizontal relative to empirical uncertainties calculated from the scatter of analysis center velocities. In the vertical, published velocity uncertainties are both over and underreported and vary more widely between centers. An interpolated ensemble vertical velocity field shows high-subsidence regions in the Central Valley and Salton Trough have the largest empirical uncertainties, while station density has a modest impact on uncertainties. Applications that rely on subcentimeter GPS accuracy should consider the possibility that formal errors published with velocity rate estimates understate true velocity uncertainties in both the horizontal and vertical.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Uncertainty Analysis in Multi‐Sector Systems: Considerations for Risk Analysis, Projection, and Planning for Complex Systems

Abstract Simulation models of multi‐sector systems are increasingly used to understand societal resilience to climate and economic shocks and change. However, multi‐sector systems are also subject to numerous uncertainties that prevent the direct application of simulation models for prediction and planning, particularly when extrapolating past behavior to a nonstationary future. Recent studies have developed a combination of methods to characterize, attribute, and quantify these uncertainties for both single‐ and multi‐sector systems. Here, we review challenges and complications to the idealized goal of fully quantifying all uncertainties in a multi‐sector model and their interactions with policy design as they emerge at different stages of analysis: (a) inference and model calibration; (b) projecting future outcomes; and (c) scenario discovery and identification of risk regimes. We also identify potential methods and research opportunities to help navigate the tradeoffs inherent in uncertainty analyses for complex systems. During this discussion, we provide a classification of uncertainty types and discuss model coupling frameworks to support interdisciplinary collaboration on multi‐sector dynamics (MSD) research. Finally, we conclude with recommendations for best practices to ensure that MSD research can be properly contextualized with respect to the underlying uncertainties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Compounding Uncertainties in Economic and Population Growth Increase Tail Risks for Relevant Outcomes Across Sectors

Understanding the long-term effects of population and GDP changes requires a multisectoral and regional understanding of the coupled human-Earth system, as the long-term evolution of this coupled system is influenced by human decisions and the Earth system. This study investigates the impact of compounding economic and population growth uncertainties on long-term multisectoral outcomes. We use the Global Change Analysis Model (GCAM) to explore the influence of compounding and feedback between future GDP and population growth on four key sectors: final energy consumption, water withdrawal, staple food prices, and CO 2 emissions. The results show that uncertainties in GDP and population compound, resulting in a magnification of tail risks for outcomes across sectors and regions. Compounding uncertainties significantly impact metrics such as CO 2 emissions and final energy consumption, particularly at the upper tail at both global and regional levels. However, the impact of staple food prices and water withdrawal depends on regional factors. Additionally, an alternative low-carbon transition scenario could compound uncertainties and increase tail risk, particularly in staple food prices, highlighting the influence of emergent constraints on land availability and food-energy competition for land use. The findings underscore the importance of considering and adequately accounting for compounding uncertainties in key drivers of multisectoral systems to enhance our comprehensive understanding of the complex nature of multisectoral systems. The paper provides valuable insights into the potential implications of compounding uncertainties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Characterizing How Meteorological Forcing Selection and Parameter Uncertainty Influence Community Land Model Version 5 Hydrological Applications in the United States

Despite the increasing use of large-scale Land Surface Models (LSMs) in predicting hydrological responses in extreme conditions, there's a critical gap in understanding the uncertainties in these predictions. This study addresses this gap through a detailed diagnostic evaluation of the uncertainties arising from meteorological forcing selection and model parametrization in hydrological simulations of the Community Land Model version 5 (CLM5). CLM5 is configured at a spatial scale of about 12-km to simulate runoff processes for 464 headwater watersheds, selected from the Catchment Attributes for Large-Sample Studies (CAMELS) dataset to be representative of physiographic and climatic gradients across the conterminous United States. For each watershed, CLM5 is driven by five commonly used gridded forcing datasets in combination with a large ensemble (> 1200) of key CLM5 hydrologic parameters. Our results suggest that uncertainty in CLM5 runoff simulations resulting from both forcing and parametric sources is markedly higher in arid regions, e.g., Great Plains and Midwest regions. Uncertainty in low flow is dominated by parametric uncertainty, while the selection of meteorological forcing contributes more dominantly to high flow and seasonal flows during fall and spring. Our analysis also demonstrates that the selection of forcing datasets and the metrics used to calibrate CLM5 significantly impact the model’s predictive accuracy in extreme event severity for both floods and droughts. Overall, the results from this study highlight the need to understand and account for forcing and parametric uncertainties in CLM5 simulations, particularly for hazard and risk assessments addressing hydrologic extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Uncertainty quantification for molecular property predictions with graph neural architecture search

Graph Neural Networks (GNNs) have emerged as a prominent class of data-driven methods for molecular property prediction. However, a key limitation of typical GNN models is their inability to quantify uncertainties in the predictions. This capability is crucial for ensuring the trustworthy use and deployment of models in downstream tasks. To that end, we introduce AutoGNNUQ, an automated uncertainty quantification (UQ) approach for molecular property prediction. AutoGNNUQ leverages architecture search to generate an ensemble of high-performing GNNs, enabling the estimation of predictive uncertainties. Our approach employs variance decomposition to separate data (aleatoric) and model (epistemic) uncertainties, providing valuable insights for reducing them. In our computational experiments, we demonstrate that AutoGNNUQ outperforms existing UQ methods in terms of both prediction accuracy and UQ performance on multiple benchmark datasets, and generalizes well to out-of-distribution datasets. Additionally, we utilize t-SNE visualization to explore correlations between molecular features and uncertainty, offering insight for dataset improvement. AutoGNNUQ has broad applicability in domains such as drug discovery and materials science, where accurate uncertainty quantification is crucial for decision-making.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Templates of expected measurement uncertainties

The covariance committee of CSEWG (Cross Section Evaluation Working Group) established templates of expected measurement uncertainties for neutron-induced total, (n,γ), neutron-induced charged-particle, and (n,xn) reaction cross sections as well as prompt fission neutron spectra, average prompt and total fission neutron multiplicities, and fission yields. Templates provide a list of what uncertainty sources are expected for each measurement type and observable, and suggest typical ranges of these uncertainties and correlations based on a survey of experimental data, associated literature, and feedback from experimenters. Information needed to faithfully include the experimental data in the nuclear-data evaluation process is also provided. These templates could assist (a) experimenters and EXFOR compilers in delivering more complete uncertainties and measurement information relevant for evaluations of new experimental data, and (b) evaluators in achieving a more comprehensive uncertainty quantification for evaluation purposes. This effort might ultimately lead to more realistic evaluated covariances for nuclear-data applications. In this topical issue, we cover the templates coming out of this CSEWG effort–typically, one observable per paper. This paper here prefaces this topical issue by introducing the concept and mathematical framework of templates, discussing potential use cases, and giving an example of how they can be applied (estimating missing experimental uncertainties of 235 U(n,f) average prompt fission neutron multiplicities), and their impact on nuclear-data evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗