Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for Composite Analysis.

The purpose of this environmental calculation file (ECF) is to provide a summary of methodology, inputs, assumptions, and results of a Special Analysis (SA) titled “Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for the Updated Composite Analysis.” This SA is one of the three SAs conducted in Fiscal Year (FY) 2024 for the Composite Analysis (CA) for the Hanford Site (DOE/RL-2019-52, Composite Analysis for Low-Level Waste Disposal in the Hanford Site Central Plateau (FY 2020)), and it is performed following the Unreviewed Composite Analysis Question Evaluation procedure, UCAQ-24-01-E (UCAQ-24-01-E, Rev. 0).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Advancing uncertainty characterization for understanding projected water scarcity in multi-sector, multi-actor river basins across scales.

Invited Talk at AGU Fall Meeting 2023 Modeling how human institutions and infrastructure interact with the water cycle is essential to better understand the vulnerability, and resilience of water resources systems from the local to the global scale. This is especially true when investigating multi-sector, multi-actor responses to the effects of long-term changes and short-term shocks. It is also well recognized that uncertainty present throughout the modeling cycle (e.g., in data, functional relations, and model coupling approaches) limits our ability to trace the interactive dynamics of human-water systems, as well as to quantify their implications for management and planning. Systems with large numbers of diverse stakeholders further compound this challenge, as uncertain drivers and complex dynamics might have very disparate effects on water users. The work presented is conducted through the Integrated Multisector Multiscale Modeling (IM3) Science Focus Area, which explores how human and natural systems co-evolve in response to change. Through this multi-year effort, we have developed exploratory modeling methods to better characterize how the uncertain human and natural drivers of water scarcity yield consequential vulnerabilities in institutionally complex, multi-sectoral systems. This talk will specifically present on a series of uncertainty characterization experiments performed in the Upper Colorado River Basin, a sub-basin of the Colorado with thousands of water users. These complementary and systematic experiments are aimed at understanding: How are various uncertain stressors (e.g., climate change, demand growth) affecting the diverse water users of this basin in terms of water shortage? What are the key drivers of this shortage for each user? Methods and results from this work are used to address additional questions on the ability of adaptation to modulate the effects of these uncertain drivers, and on their compounding effects across spatial scales and through sectoral interactions.

Hadjimichael, Antonia↗
DOE OSTI2024

Uncertainty characterization in a coupled human-natural system: Modeling agricultural adaptation in the Great Lakes Region

The Great Lakes Region's water quality and ecological health are threatened by the export of nutrients from agricultural lands, which causes eutrophication, hypoxia, and destructive algal blooms. The intensification of hydrologic cycles brought about by climate change is expected to exacerbate nutrient loading in the region, and, at the same time, agricultural adaptation to changing conditions is also expected to affect loading through shifting amounts and timing of fertilization. Quantifying these future effects and their interactions necessitates modeling both the human and natural processes as a coupled system, by pairing land use and agricultural management with hydrologic modeling. At the same time, compounding uncertainties arising from the complex interactions in both systems significantly limit our predictive understanding of the region's impacts. This study utilizes the Soil and Water Assessment Tool (SWAT), developed for simulating the impact of various farmer decisions on watershed functions in Western Lake Erie watersheds, and an under-development agent-based model (ABM) for agricultural management decisions. The aim of this study is to use global sensitivity analysis on the coupled ABM and SWAT models to quantify how uncertainty in both models interactively affects nutrient loading. To do so, we will conduct Sobol sensitivity analysis experiments at different levels of coupling assumptions to quantify how various uncertain factors (e.g., soil moisture and crop choice) and their interactions affect our estimates of nutrient loading. The results of this analysis will allow us to quantify how complex interactions and dependencies between both systems amplify the effect of uncertainties. Insights gained from this study will have broader implications for modeling the adaptive co-evolution of human and natural systems under climate change and can inform effective management of nutrient loading in the Great Lakes Region.

Climate Change↗
DOE OSTI2021

Characterizing uncertainties in ground “truth” of precipitation over complex terrain through high-resolution numerical modeling

Ground observation of precipitation over complex terrain is subject to large uncertainties due to inadequate sampling. This study explores a method that combines limited gauge data and a high-resolution numerical simulation to quantify the precipitation uncertainties in central Himalaya. Specifically, the Coefficient of spatial Variability (CV) of precipitation and the minimum Number of Required Stations (NRS) to obtain areal-mean precipitation ground truth values within a 0.25-degree area are investigated using fine-scale meteorological simulation at 1.5 km grid spacing. Evaluation over a densely-gauged area demonstrates comparable CV and NRS values between station observations and simulations. The simulated CV and NRS values in a larger area show a strong and positive dependence on each other and an expected positive (negative) correlation with topographic complexity (temporal scale). The proposed method sheds lights on evaluating precipitation products and holds promise for informing the layout of rain gauge networks in complex terrain.

Ouyang, Lin↗
DOE OSTI2026

Characterizing Uncertainty in Synthetic Tropical Cyclone Hazard Models for U.S. Energy Infrastructure Resilience

Tropical Cyclones (TCs) are intense storms that pose a persistent and considerable risk to coastal communities and infrastructure in the global tropics and subtropics, including the United States (US). With known limitations associated with observations and high-resolution earth system models, synthetic TC models that capture a wide spectrum of storm possibilities have been developed to robustly quantify TC risk. Here we examine the simulation of various TC features in the North Atlantic relevant for US coastal risk in three synthetic TC models forced with ERA5 reanalysis: MIT, CHAZ and RAFT. While there is a broad agreement among these models in terms of their representation of salient TC characteristics, certain differences do exist. To connect these modeling uncertainties with energy infrastructure resilience, we apply fragility curves that link simulated TC intensities to damage probabilities, demonstrating how uncertainty in storm states may translate into that in coastal impacts. Our study indicates that acknowledging and accounting for inter-model uncertainty leads to more reliable risk assessments, strengthening science-to-action pathways for managing risks associated with TCs.

Baby John, Effy↗
NASA NTRS1996

Identification, Uncertainty Characterization and Robust Control Synthesis Applied to Large Flexible Structures Control

This paper demonstrates an approach to frequency domain identification for the explicit purpose of designing robust H(infinity) controllers. The approach transforms raw experimental data into a plant set estimate directly usable by modern robust control design software(e.g., Matlab Robust Control Toolboxes [11][2]). A key issue in control design from raw data is the question of whether the controller will work when applied to the true system. The main feature fo this approach is that the resulting controller in guaranteed to work as designed(when applied to the true system) to a prescribed statistical confidence. While the overall methodology addresses key theoretical issues, it has at the same time been specifically designed to support practical implementations. A simulation example is included to demonstrate the overall approach.

software↗
DOE OSTI2024

Characterizing Interaction Uncertainty in Human-Machine Teams

With the increasing use and adoption of artificial intelligence (AI), the reliability of modern data systems will be driven by a tighter teaming between human experts and intelligent machine teammates. As in the case of human-human teams, the success of human-machine teams will also rely on clear communication about mutual goals and actions. In this paper, we combine related literature from cognitive psychology, human-machine teaming, uncertainty in data analysis, and multi-agent systems to propose a new form of uncertainty: interaction uncertainty for characterizing bidirectional communication in human-machine teams. We map the causes and effects of interaction uncertainty and outline potential ways to mitigate uncertainty for mutual trust in a high-consequence real-world scenario.

uncertainty, data analytics, interaction, trust, h↗
DOE OSTI2025

Characterization of uncertainties in electron-argon collision cross sections

Abstract The predictive capability of a plasma discharge model depends on accurate representations of electron-impact collision cross sections, which determine the corresponding reaction rates and electron transport properties. The values of cross sections can be known only approximately either through experiments or simulations and are thus subject to uncertainties. Quantifying the uncertainties in plasma simulations allows us to assess the reliability of simulations and to provide a basis for interpreting discrepancies between simulations and experiments. For such uncertainty quantification of plasma simulations, it is essential to quantify the uncertainties of the underlying cross sections. Although much effort has been committed to calibrate the cross section values, their uncertainties are not well investigated. We characterize uncertainties in electron-argon atom collision cross sections using a Bayesian framework. Six collision processes—elastic momentum transfer, ionization, and four excitations—are characterized with semi-empirical models, which effectively capture the features important to the macroscopic properties of the plasma. A probability model for the uncertain parameters of these semi-empirical models is developed. Specifically, a Gaussian-process likelihood model is proposed to capture discrepancies among data sets, as well as the model-form inadequacies of the semi-empirical models. Two other likelihood models are compared with the proposed Gaussian-process model, to illustrate the importance of the choice of the likelihood model. The cross section models are calibrated using the electron-beam experiments and ab-inito quantum simulations. The resulting calibrated uncertainties capture well the scattering among the data sets. The calibrated cross section models are further validated against swarm-parameter experiments and zero-dimensional Boltzmann equation simulations of widely used cross section datasets.

Chung, Seung Whan (ORCID:0000000302501549)↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
DOE OSTI2024

Characterizing model uncertainties in simulated coast-to-offshore wind over the northeast U.S. using multi-platform measurements from the TCAP field campaign

Numerical weather prediction (NWP) models, such as the Weather Research and Forecasting (WRF) model, are widely used to provide estimates of the offshore wind energy resource owing to their large spatial coverage compared to available observations. Nevertheless, spatiotemporal distribution of model biases is highly dependent on factors including model configuration, location, and the interplay of multi-scale physical processes. Here, in this study, we focus on the characterization of model uncertainties in simulated coast-to-offshore winds over the northeast U.S., by varying sea surface temperature (SST) forcings, surface layer (SL) and planetary boundary layer (PBL) parameterizations, as well as identifying biases that may be directly passed from initial and boundary conditions. Multiple measurements, including aircraft data collected during the U.S. Department of Energy's Two-Column Aerosol Project (TCAP) experiment, are used to constrain the model results and facilitate quantitative comparisons. Our analysis indicates while SST forcing has notable impacts on simulated air temperature and moisture within PBL, the modeled winds are in general more sensitive to the choices of SL and PBL physics than to SST. The model’s forcing data not only controls the vertical dependence of wind speed errors, but also alters regional variability in wind speed’s spatial correlation. Bias comparisons between ERA5 reanalysis and ensemble simulations revealed significant similarity, particularly in wind speed biases during winter, underscoring their dependency on initial and boundary conditions. Coastal and offshore near-surface wind speed biases tend to exhibit much higher similarity in winter than in summer due to the presence of much stronger and more persistent synoptic wind conditions. This study highlights the importance of accurate atmospheric forcing and parameterization choices in improving wind forecasts and suggests the potential for extrapolating coastal wind biases to offshore locations, aiding wind energy forecasting and informing the Wind Forecast Improvement Project-3 (WFIP3).

17 WIND ENERGY↗
DOE OSTI2025

Combined Meteorological and Hydrologic Uncertainties Shape Projections of Future Soil Moisture in the Eastern United States

Physical hazards pose risks to many critical systems. Designing adaptive measures to mitigate these risks is challenging due to large uncertainties in modeling future hazards and the associated sectoral responses. Here, we help address this challenge in a hydrologic context by examining the combined role of meteorological forcing and hydrologic parameter uncertainties in shaping projections of future soil moisture. By encoding a simple conceptual water balance model in a differentiable programming framework, we facilitate fast runtimes and an efficient calibration, enabling an improved uncertainty analysis. We characterize uncertainty in model parameters by calibrating against different target data sets and by using several loss functions. We then convolve the resulting parameter ensemble with a set of Earth system model projections to produce a large ensemble (2,340 members) of daily soil moisture simulations. Focusing on the eastern United States, we find that most ensemble members project a drying of soils across the region, although some simulate wetter conditions throughout this century. Our ensemble shows an increase in the frequency and intensity of dry extremes while there is less agreement for wet extremes. We conduct sensitivity analyses on several soil moisture signatures to measure the relative influence of meteorological and hydrologic uncertainties across space and time. Both meteorological and hydrologic factors contribute consistently to uncertainty surrounding long-term trends, while changes to both wet and dry soil extremes are typically more sensitive to hydrologic parameter uncertainty. Our results underscore the need to account for varied sources of uncertainty when developing long-term hydrometeorological projections.

Lafferty, David C. [University of Illinois Urbana‐↗
NASA NTRS2014

The NASA Langley Multidisciplinary Uncertainty Quantification Challenge

This paper presents the formulation of an uncertainty quantification challenge problem consisting of five subproblems. These problems focus on key aspects of uncertainty characterization, sensitivity analysis, uncertainty propagation, extreme-case analysis, and robust design.

Crespo, Luis G.↗
NASA NTRSDate not supplied

PACE OCI Short-Wave Infrared Detection Assembly frequency-dependent linearity characterization and uncertainty analysis

The Ocean Color Instrument (OCI), the primary payload of the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE)observatory, will collect data to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared(SWIR) Detection Assembly (SDA) was built and characterized by the Utah State University Space DynamicsLaboratory (SDL) and is a subsystem of OCI. The SDA measures seven bands centered at 940, 1038, 1250, 1378,1615, 2130, and 2260 nm, with standard- and high-gain varieties for the 1250 and 1615 nm bands, resulting in nine total detection configurations in the SWIR. The delivery of high-quality science data is critically dependent upon accurately characterizing the linearity of the SDA. Two metrology techniques were employed to measure the linearity and characterize the frequency-dependent linearity uncertainty of the system. The first technique used superposition linearity measurements to determine the DC linearity, and the second technique involved an oscillating small-signal response at seven frequencies to determine the frequency-dependent linearity. Discrepancies between the DC and frequency-dependent linearities constrain the uncertainty between the two. Examining the difference between these two methods for all SDA channels, we find most channels experience an uncertainty below0.2% with a worst-case measurement uncertainty of 0.31%. Averaging SDA channels with similar detectors, optical filters, and electronics to simulate the flight-like data products yields a worst-case frequency-dependence linearity uncertainty of 0.12%, demonstrating minimal frequency dependence, implying an excellent linearity knowledge.Detailed performance knowledge, including linearity performance, verifies data quality and builds confidence in the success of the PACE mission.

PACE↗
DOE OSTI2024

Topological Characterization and Uncertainty Visualization of Atmospheric Rivers

Atmospheric rivers (ARs) are long, narrow regions of water vapor in the Earth's atmosphere that transport heat and moisture from the tropics to the mid-latitudes. ARs are often associated with extreme weather events in North America and contribute significantly to water supply and flood risk. However, characterizing ARs has been a major challenge due to the lack of a universal definition and their structural variations. Existing AR detection tools (ARDTs) produce distinct AR boundaries for the same event, making the risk assessment of ARs a difficult task. Understanding these uncertainties is crucial to improving the predictability of AR impacts, including their landfall areas and associated precipitation, which could cause catastrophic flooding and landslides over the coastal regions. In this work, we develop an uncertainty visualization framework that captures boundary and interior uncertainties, i.e., structural variations, of an ensemble of ARs that arise from a set of ARDTs. We first provide a statistical overview of the AR boundaries using the contour boxplots of Whitaker et al. that highlight the structural variations of AR boundaries based on their nesting relationships. We then introduce the topological skeletons of ARs based on Morse complexes that characterize the interior variation of an ensemble of ARs. We propose an uncertainty visualization of these topological skeletons, inspired by MetroSets of Jacobson et al. that emphasizes the agreements and disagreements across the ensemble members. Through case studies and expert feedback, we demonstrate that the two approaches complement each other, and together they could facilitate an effective comparative analysis process and provide a more confident outlook on an AR's shape, area, and onshore impact.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Bayesian characterization of uncertainties surrounding fluvial flood hazard estimates

Fluvial floods drive severe risk to riverine communities. There is strong evidence of increasing flood hazards in many regions around the world. The choice of methods and assumptions used in flood hazard estimates can impact the design of risk management strategies. In this study, we characterize the expected flood hazards conditioned on the uncertain model structures, model parameters, and prior distributions of the parameters. We construct a Bayesian framework for river stage return level estimation using a nonstationary statistical model that relies exclusively on the Indian Ocean Dipole Index. We show that ignoring uncertainties can lead to biased estimation of expected flood hazards. We find that the considered model parametric uncertainty is more influential than model structures and model priors. Our results highlight the importance of incorporating uncertainty in extreme flood stage estimates, and are of practical use for informing water infrastructure designs in a changing climate.

54 ENVIRONMENTAL SCIENCES↗