Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Event‐Based Training in Label‐Limited Regimes

Abstract The distribution of attributes assigned using data on independent sensors for a specific source, for example, magnitude, can be richly descriptive for final event characterization and associated uncertainty. Attribute distributions can also provide powerful context for event characterization in the absence of comprehensive annotation. This work develops a way to leverage distributional information across a set of sensors in the absence of comprehensive annotation as a domain‐informed regularization term applied during gradient‐based learning. The regularization term is the basis of event‐based training which I show can be a powerful semi‐supervised learning (SSL) approach. I first use a simple feed forward neural network and a toy data set to outline how data set structure interacts with the assumptions inherent to many semi‐supervised learning approaches. I then demonstrate the effectiveness of event‐based training using a deep convolutional neural network for seismic event classification in Utah, which increases SSL accuracy from 92% to 97% on event classification with a limited number of training labels.

Linville, Lisa M.↗
DOE OSTI2020

Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a sampling-based approach that has widely used for quantification and propagation of uncertainties. However, the standard MC method is often time-consuming if the simulation-based model is computationally intensive. This article gives an overview of modern MC methods to address the existing challenges of the standard MC in the context of UQ. Specifically, multilevel Monte Carlo (MLMC) extending the concept of control variates achieves a significant reduction of the computational cost by performing most evaluations with low accuracy and corresponding low cost, and relatively few evaluations at high accuracy and corresponding high cost. Multifidelity Monte Carlo (MFMC) accelerates the convergence of standard Monte Carlo by generalizing the control variates with different models having varying fidelities and varying computational costs. Multimodel Monte Carlo method (MMMC), having a different setting of MLMC and MFMC, aims to address the issue of UQ and propagation when data for characterizing probability distributions are limited. Multimodel inference combined with importance sampling is proposed for quantifying and efficiently propagating the uncertainties resulting from small data sets. All of these three modern MC methods achieve a significant improvement of computational efficiency for probabilistic UQ, particularly uncertainty propagation. Finally, an algorithm summary and the corresponding code implementation are provided for each of the modern MC methods. The extension and application of these methods are discussed in detail.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Large Ensemble Exploration of Global Energy Transitions Under National Emissions Pledges

Global climate goals require a transition to a deeply decarbonized energy system. Meeting the objectives of the Paris Agreement through countries' nationally determined contributions and long-term strategies represents a complex problem with consequences across multiple systems shrouded by deep uncertainty. Robust, large-ensemble methods and analyses mapping a wide range of possible future states of the world are needed to help policymakers design effective strategies to meet emissions reduction goals. This study contributes a scenario discovery analysis applied to a large ensemble of 5,760 model realizations generated using the Global Change Analysis Model. Eleven energy-related uncertainties are systematically varied, representing national mitigation pledges, institutional factors, and techno-economic parameters, among others. The resulting ensemble maps how uncertainties impact common energy system metrics used to characterize national and global pathways toward deep decarbonization. Results show globally consistent but regionally variable energy transitions as measured by multiple metrics, including electricity costs and stranded assets. Larger economies and developing regions experience more severe economic outcomes across a broad sampling of uncertainty. The scale of CO 2 removal globally determines how much the energy system can continue to emit, but the relative role of different CO 2 removal options in meeting decarbonization goals varies across regions. Previous studies characterizing uncertainty have typically focused on a few scenarios, and other large-ensemble work has not (to our knowledge) combined this framework with national emissions pledges or institutional factors. Our results underscore the value of large-ensemble scenario discovery for decision support as countries begin to design strategies to meet their goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Geophysical Constraints on Decarbonized Systems—Building Spatio-Temporal Uncertainties into Future Electricity Grid Planning

Future electricity grids will be characterized by the high penetration of renewables to support the decarbonization process. Yet, this transition will further expose grids to a broad spectrum of geophysical forces, such as weather and climate, land and space, minerals and materials. Understanding their role is thus important to support the grid decarbonization process. Here, we synthesize the current body of knowledge on the relationship between geophysical constraints and electricity grid planning. Additionally, we show that there have been promising advances in the data, methods, and modelling tools needed to incorporate the effect of geophysical constraints on demand, resource availability, and grid operations. There are, however, multiple research avenues that deserve further attention. More system-specific and finer-scale analyses are necessary to better understand how spatio-temporal variability---and associated uncertainty---in geophysical forces affect grid planning. Moreover, we need a broader focus on the multi-sectoral implications of grid decarbonization efforts, so as to limit the risk of unintended consequences. Importantly, all these efforts are challenged by the computational requirements of existing power system models, which often limit our ability to characterize uncertainty, scale analyses across larger domains, or study the multi-sector implications of grid expansion decisions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Gaussian Process Modeling For Experimental Procedure Uncertainty

Many laboratory experiments generate data that are characterized by a form of uncertainty that differs from noise: experimental procedure uncertainty. The origin of this type of uncertainty is the difficulty in controlling a subset of experimental conditions in such a way that the experiment is perfectly reproducible within noise. In this report, we describe a Gaussian Process modeling-based method that accounts for experimental procedure uncertainty. The method accounts for variations in conditions from experiment to experiment that are independent between experiments, but correlated within each experiment, and incorporates the resulting uncertainty into predictions at future experimental settings. The method is discussed in the context of a specific chemistry application in which Raman scattering spectra are measured from three-component mixtures.

42 ENGINEERING↗
DOE OSTI2024

Characterizing the multisectoral impacts of future global hydrologic variability

There is significant uncertainty in how global water supply will evolve in the future, due to uncertain climate, socioeconomic, and land use change drivers and variability of hydrologic processes. It is critical to characterize the potential impacts of uncertainty in future water supply given its importance for food and energy production. In this work, we introduce a framework that integrates stochastic hydrology and human-environmental systems to characterize uncertainty in future water supply and its multisector impacts. We develop a global stochastic watershed model and demonstrate that this model can generate a large ensemble of realizations of basin-scale runoff with global coverage that preserves the mean, variance, and spatial correlation of a historical benchmark. We couple this model with a well-known human-environmental systems model to explore the impacts of runoff variability on the water and agricultural sectors across spatial scales. We find that the impacts of future hydrologic variability vary across sectors and regions. Impacts are felt most strongly in the water and agricultural sectors for basins that are expected to have unsustainable water use in the future, such as the Indus River basin. For this basin, we find that the variability in future irrigation water withdrawals and irrigated cropland increase over time due to uncertainty in renewable water supply. We also use the Indus basin to show how our stochastic ensemble can be leveraged to explore the global multisector consequences of local extreme runoff conditions. This work introduces a novel technique to explore the propagation of future hydrologic variability across human and natural systems and spatial scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

EGS Stimulation Design with Uncertainty Quantification at the EGS Collab Site

Engineering a robust hydraulic connection between wells is one of the most difficult aspects of enhanced geothermal systems (EGS). Designing and constructing such hydraulic connections requires and understanding of the in situ state of stress and the heterogeneities and discontinuities that naturally exist and may control the stimulation. Even with comprehensive stress and formation characterization programs substantial uncertainty remains in these key parameters. This is especially the case in high-temperature EGS environments where drilling conditions are often difficult and a far fewer logging and testing options are available. This paper presents a new approach for explicitly quantifying the uncertainties in the state of stress using a Bayesian Markov Chain Monte Carlo method. This approach produces a probability distribution for the stress tensor, including a general 3D orientation, that reflects the uncertainties in all the observations or indicators used to constrain the stress state. This method is demonstrated on the characterization data for the EGS Collab Experiment 2 site. The output of the analysis is used to guide the design of the planned stimulations. In the case of research projects like EGS Collab, explicitly quantifying the uncertainties in the stress state allow for more rigorous hypothesis testing by allowing conclusions drawn from the experiments to be interpreted in the context of the uncertain knowledge about conditions in the test bed.

Burghardt, Jeffrey A.↗
DOE OSTI2020

TRUST-EABM End-of-Year Report: Release FY20

The Delivery Environments (DE) program work package Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) is designed to quantify and reduce the uncertainty associated with experimental testing and numerical simulation of large engineering assemblies to support the efficient and responsive development of future systems. Because engineering assemblies contain a large number of uncertainty sources, well-characterized testbeds must be designed to isolate individual uncertainty sources. Once quantified, uncertainty sources can be compared to direct research and development funding towards the largest sources driving behavior of interest. Quantified uncertainty may also be propagated through engineering simulations to determine quantitative confidence in simulation predictions and for comparison against uncertainty in the experimental measurements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Developing an Automated Uncertainty Quantification Tool to Improve Watershed-Scale Predictions of Water and Nutrient Cycling

Managing the flow of water, nutrients, and contaminants in watersheds is vital to addressing pressing issues related to water scarcity, access to clean drinking water, energy production, resilience to natural and anthropogenic perturbations, and ecological restoration. Decisions about the management of watersheds critically depend on the accuracy with which the flow of water and chemicals through the watershed can be predicted by computer models. Prediction uncertainty can be reduced by matching the model to data, which are collected in the field at great expense. The contribution of watershed characterization data to reducing uncertainty of relevant model predictions can be evaluated in a so-called data-worth analysis, which provides transparent, quantitative metrics about a data set’s value for the support of relevant watershed management objectives. To achieve this goal, we developed a software package that implements the data-worth analysis approach for use with state-of-the-art watershed models. The purpose of the proposed data-worth analysis is to help decision-makers allocate resources for watershed characterization such that the uncertainty in model predictions can be significantly reduced, which leads to better, more effective management decisions. At the same time, watershed characterization costs can be reduced. The specific technical objectives of this SBIR/STTR Phase II project were to develop a framework and associated software toolsets that implement the uncertainty quantification and data-worth analysis approach for use with state-of-the-art watershed models. This goal was achieved by (A) developing a user-friendly, robust software package that is accessible to a wide audience, including watershed managers, policy-makers, and public stakeholders; (B) by demonstrating application of the prototype on several use cases that are representative of complex watershed management challenges spanning a range of scales and that consider different open-source, DOE-based codes and other modeling platforms; and (C) by gathering information about the needs and requirements from potential users to help guide future developments, ensuring that the final product will be commercially viable. The developed software consists of a graphical user interface that guides the user through a sequence of analysis steps, supported by toolsets that leverage state-of-the-art computational simulation-optimization capabilities. A prototype of the software runs on multiple platforms (PC, Mac, multi-processor Linux environment), is linked to diverse watershed simulators (e.g., ECOSYS, TOUGH2, TOUGHREACT, Amanzi-ATS), performs multiple analysis tasks (predictive simulations, sensitivity analysis, uncertainty analysis, automatic parameter estimation, and data-worth analysis, multicomponent geothermometry), and is readily extensible to include external simulators and analysis tools. The software is being commercialized and will be continually updated to address user needs.

58 GEOSCIENCES↗
DOE OSTI2026

Uncertainty Quantification (UQ) for AI fact Sheet

UQ is traditionally defined as quantitative characterization and estimation of uncertainties in both computational and real-world applications. It tries to determine how likely certain outcomes are if some aspects of the system are not exactly known.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An extended polynomial chaos expansion for PDF characterization and variation with aleatory and epistemic uncertainties

This paper presents an extended polynomial chaos formalism for epistemic uncertainties and a new framework for evaluating sensitivities and variations of output probability density functions (PDF) to uncertainty in probabilistic models of input variables. An ”extended” polynomial chaos expansion (PCE) approach is developed that accounts for both aleatory and epistemic uncertainties, modeled as random variables, thus allowing a unified treatment of both types of uncertainty. We explore in particular epistemic uncertainty associated with the choice of prior probabilistic models for input parameters. A PCE-based Kernel Density (KDE) construction provides a composite map from the PCE coefficients and germ to the PDF of quantities of interest (QoI). Here, the sensitivities of these PDF with respect to the input parameters are then evaluated. Input parameters of the probabilistic models are considered. By sampling over the epistemic random variable, a family of PDFs is generated and the failure probability is itself estimated as a random variable with its own PCE. Integrating epistemic uncertainties within the PCE framework results in a computationally efficient paradigm for propagation and sensitivity evaluation. Two typical illustrative examples are used to demonstrate the proposed approach.

Aleatory uncertainty↗
DOE OSTI2025

Characterizing How Meteorological Forcing Selection and Parameter Uncertainty Influence Community Land Model Version 5 Hydrological Applications in the United States

Despite the increasing use of large-scale Land Surface Models (LSMs) in predicting hydrological responses in extreme conditions, there's a critical gap in understanding the uncertainties in these predictions. This study addresses this gap through a detailed diagnostic evaluation of the uncertainties arising from meteorological forcing selection and model parametrization in hydrological simulations of the Community Land Model version 5 (CLM5). CLM5 is configured at a spatial scale of about 12-km to simulate runoff processes for 464 headwater watersheds, selected from the Catchment Attributes for Large-Sample Studies (CAMELS) dataset to be representative of physiographic and climatic gradients across the conterminous United States. For each watershed, CLM5 is driven by five commonly used gridded forcing datasets in combination with a large ensemble (> 1200) of key CLM5 hydrologic parameters. Our results suggest that uncertainty in CLM5 runoff simulations resulting from both forcing and parametric sources is markedly higher in arid regions, e.g., Great Plains and Midwest regions. Uncertainty in low flow is dominated by parametric uncertainty, while the selection of meteorological forcing contributes more dominantly to high flow and seasonal flows during fall and spring. Our analysis also demonstrates that the selection of forcing datasets and the metrics used to calibrate CLM5 significantly impact the model’s predictive accuracy in extreme event severity for both floods and droughts. Overall, the results from this study highlight the need to understand and account for forcing and parametric uncertainties in CLM5 simulations, particularly for hazard and risk assessments addressing hydrologic extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The NuMI Flux Prediction at ICARUS

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long-baseline neutrino oscillation experiment seeking to probe fundamental symmetries within the structure of the Pontecorvo-Maki-Nakagawa-Sakata (PMNS) mixing matrix, and perform precision measurements its parameters including the neutrino mass ordering via the sign of $\Delta m^2_{31}$, and the charge-parity violating phase, $\delta_{CP}$. To make these measurements with high precision, DUNE will require external $\nu$-Ar scattering cross section data as a crucial input to the oscillation fit. Imaging Cosmic And Rare Underground Signals (ICARUS) is a 476 t liquid argon neutrino detector located at Fermi National Accelerator Laboratory (FNAL) where it is serving as the far detector for the Short-Baseline Neutrino (SBN) program along the Booster Neutrino Beam (BNB) axis. ICARUS additionally lies 795 m downstream and 100.1 mrad off-axis of the Neutrinos at the Main Injector (NuMI) neutrino beam. From this position, ICARUS is exposed to a large flux of NuMI (anti-)electron and (anti-)muon neutrinos, and poses a unique opportunity to provide high-statistics measurements of quasi-elastic and single pion-production cross sections for four neutrino flavors ($\nu_{\mu}$, $\nu_{e}$, $\bar{\nu}_{\mu}$, $\bar{\nu}_{e}$). This dissertation is centered around accurately characterizing the models and estimating their precision for use in making these measurements. This includes identifying major sources of uncertainty in the models such that they can be properly propagated to the cross section measurements. Specifically, this work focused on the model of the NuMI beamline and its impact on the neutrino fluxes, but also delved into the detector response model and its impact on reconstructed observables in the detector. Significant efforts were made to improve the characterization to enhance precision and thus reduce the level of propagated uncertainty. In particular, the NuMI flux was determined to be composed of 57% $\nu_{\mu}$, 38% $\bar{\nu}_{\mu}$, 3% $\nu_{e}$, and 2% $\bar{\nu}_{e}$ while the horns are operating in the positive-particle focusing configuration. The total uncertainty on the $\nu_{\mu} + \bar{\nu}_{\mu}$ ($\nu_{e} + \bar{\nu}_{e}$) flux while operating in the forward horn operating mode was determined to be 10.84% (9.04%). Compared to the on-axis flux, mesons that eventually decay to neutrinos more frequently reinteract within the NuMI structure, resulting in elevated uncertainty as these processes are not well-constrained by existing hadron interaction cross section measurements. Covariance matrices were calculated to propagate the flux uncertainty characterization to NuMI analyses.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Towards Improved Decision Making for the Smarter Grid: Geomagnetic Disturbance Implicit Modeling Uncertainty Quantification

Geomagnetic disturbances can greatly disrupt the power grid operation. This is caused by low-frequency changes in the earth’s magnetic field, which upon interaction with the deep earth conductivity induces a changing electric field at the earth’s surface. This in turn induces quasi-direct currents which have the potential to cause protective devices to operate, widespread damage to high-voltage transformers, or voltage collapse due to induced reactive power losses. While these impacts have been known since the 1940s, only recently have standards for GMD response been implemented. Because these standards are heavily based on models, it is important to understand when it is appropriate to make certain modeling assumptions. In this work, implicit modeling uncertainty is quantified for the purpose of enhanced decision making for disturbance impact mitigation. Considering electromagnetic models, modeling assumptions of non-uniform grounding, imbalanced operation, transformer saturation, and geomagnetically induced currents, voltage estimation values are analyzed. Statistical characteristics of modeling uncertainty are obtained by analysis of synthetically generated data. Results statistically characterize geomagnetic disturbances modeling uncertainty, providing an important tool for impact mitigation.

grid analysis↗
DOE OSTI2020

Data-Driven Approach for Uncertainty Propagation and Reachability Analysis in Dynamical Systems

In this paper, we propose a data-driven approach for uncertainty propagation and reachability analysis in a dynamical system. The proposed approach relies on the linear lifting of a nonlinear system using linear Perron-Frobenius (P-F) and Koopman operators. Here, the uncertainty can be characterized in terms of the moments of a probability density function. We demonstrate how the P-F and Koopman operators are used for propagating the moments. Time-series data is used for the finite-dimensional approximation of the linear operators, thereby enabling data-driven approach for moment propagation. Simulation results are presented to demonstrate the effectiveness of the proposed method.

42 ENGINEERING↗