SEARCH · Search NASA

Results for “uncertainty in complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Improving net ecosystem CO2 flux prediction using memory-based interpretable machine learning

Terrestrial ecosystems play a central role in the global carbon cycle and affect climate change. However, our predictive understanding of these systems is still limited due to their complexity and uncertainty about how key drivers and their legacy effects influence carbon fluxes. Here, we propose an interpretable Long Short-Term Memory (iLSTM) network for predicting net ecosystem CO 2 exchange (NEE) and interpreting the influence on the NEE prediction from environmental drivers and their memory effects. We consider five drivers and apply the method to three forest sites in the United States. Besides performing the prediction in each site, we also conduct transfer learning by using the iLSTM model trained in one site to predict at other sites. Results show that the iLSTM model produces good NEE predictions for all three sites and, more importantly, it provides reasonable interpretations on the input driver's importance as well as their temporal importance on the NEE prediction. Additionally, the iLSTM model demonstrates good across-site transferability in terms of both prediction accuracy and interpretability. The transferability can improve the NEE prediction in unobserved forest sites, and the interpretability advances our predictive understanding and guides process-based model development.

Liu, Siyan↗

DOE OSTI2020

¬¬Integration of Quantification of Margins and Uncertainties Methodology into Parallel Discrete Event Simulator Framework

Parallel Discrete Events Simulation (PDES) is becoming increasingly important to lab efforts in security and intelligence. It is used to model complex asynchronous systems such as computer networks, satellite systems, vehicular traffic, and human performance. Uncertainty Quantification (UQ) techniques have become a mainstay of Verification and Validation (V&V) efforts on physics simulations. However, PDES models are very different from traditional physics simulations, and research into UQ techniques for PDES is in its infancy. It is not clear which traditional UQ techniques can be applied to PDES, or what new techniques will need to be developed. The goal of this project was to identify existing UQ techniques that can be applied to PDES, and to develop new techniques as necessary. The project implemented or developed techniques to handle issues that do not appear in traditional physics simulations, but are common among PDES, including sampling techniques for high-dimensional homogenous inputs, response surfaces for high-variance heteroskedastic output, and characterization of skewed output distributions. These are foundational UQ techniques that must be used in any complete UQ analysis (Tong 2018).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Flow Enhanced Electrochemical Sensor Performance in Complex Salt Systems

To advance MSR MC&A practices, Argonne National Laboratory developed and optimized robust flow enhanced electrochemical sensors (FEES) and multielectrode array voltammetry sensors (MAVS) which provide accurate near-real time measurements of actinides in molten salts. Flow-enhanced electrochemical sensors are installed directly into MSR flow conduits for inline salt chemistry measurement, while MAVS are deployed in quiescent salt conditions enabling online species concentration determination in stationary salt vessels. This report summarizes efforts to improve electrochemical sensor technological readiness through (1) sensor testing in complex, high concentration molten salt systems to demonstrate low uncertainty actinide measurements in MSR-representative solutions and (2) demonstrations of sensor performance in challenging real-world conditions in collaboration with partner MSR institutions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Disentangling atmospheric, hydrological, and coupling uncertainties in compound flood modeling within a coupled Earth system model

Compound riverine and coastal flooding is usually driven by complex interactions among meteorological, hydrological, and ocean extremes. However, existing efforts to model this phenomenon often do not integrate hydrological processes across atmosphere–land–river–ocean systems, leading to substantial uncertainties that have not been fully examined. To bridge this gap, we leverage the new capabilities of the Energy Exascale Earth System Model (E3SM) that enable a multi-component framework that integrates coastally refined atmospheric, terrestrial, and oceanic components. We evaluate compound uncertainties arising from two-way land–river–ocean coupling in E3SM and track the cascading meteorological and hydrological uncertainties through ensemble simulations over the Delaware River basin and estuary during Hurricane Irene (2011). Our findings highlight the importance of two-way river–ocean coupling to compound flood modeling and demonstrate E3SM's capability in capturing compound flood extent near the coast, with a hit rate over 0.75. Our study shows the growing uncertainties that transition from atmospheric forcings to flood distribution and severity. Furthermore, an analysis based on artificial neural networks is used to assess the roles of hydrological drivers, such as infiltration and soil moisture, in the generation of compound flooding. The response of compound floods to tropical cyclones (TCs) is found to be susceptible to these often overlooked drivers. For instance, the flooded area could increase more than 2-fold (∼2.4) if Hurricane Irene were preceded by an extreme antecedent soil moisture condition (AMC). The results not only support the use of a multi-component framework for interactive flooding processes, but also underscore the necessity of broader definitions of compound flooding that encompass the simultaneous occurrence of intense precipitation, storm surge, and high AMC during TCs.

Feng, Dongyu [Pacific Northwest National Laborator↗

DOE OSTI2022

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗

DOE OSTI2022

The System for on-Axis Neutrino Detection at the DUNE Near Detector complex

The Deep Underground Neutrino Experiment Near Detector complex aims at constraining the systematic uncertainties and deconvolving the neutrino beam flux and cross-section models. The System for on-Axis Neutrino Detection (SAND) is the Near Detector component permanently on-axis. SAND is based on the 0.6 T superconducting magnet and electromagnetic calorimeter previously used in the KLOE experiment. The 40 m3 magnetic volume will be filled with an active target/tracker system. One considered option foresees an upstream liquid Argon active target (about 1.5 t) and a Straw Tube Tracker (about 5 t). In this talk the design of SAND will be described and its performances discussed in view of the SAND primary goals, namely the beam monitoring and neutrino flux measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Visual‐Analytics Bridge Complexity and Accessibility for Robust Urban Water Planning

Urban water resources planning is complicated by unprecedented uncertainty in supply and demand. Real‐world planning often simplifies the full range of uncertainty faced by a system into a limited set of deterministic scenarios to enhance accessibility for decision‐makers and the public. However, overlooking uncertainty can expose the system to failures. On the other end of the spectrum, academically developed tools for scenario analysis rigorously quantify the combined effects of multiple sources of uncertainty, but the practical application of these models is limited by the challenges of information visualization and communication of results. In short, municipal water supply planners lack access to planning frameworks that effectively integrate a rigorous treatment of uncertainty with accessible, user‐friendly visual and interactive tools to enhance user accessibility. In this work, we fill this gap by proposing Visual‐Robust Decision Making, and demonstrate an application for the city of Santa Barbara (SB), CA. Santa Barbara faces multiple uncertainties from pending state and federal regulations to changing hydrology and water demand. The city seeks to increase its water portfolio robustness by expanding its seawater desalination plant, but must decide how much capacity to add. We introduce computational tools that assess uncertainty across nine uncertain drivers identified with the help of water planners in SB. To allow public participation in the desalination expansion decision, we develop interactive visual‐analytics to aid decision‐makers and stakeholders in navigating complex scenario analysis outcomes. Our results quantify the tradeoffs between increased capacity and system robustness and aim to enhance participation and uncertainty characterization of urban water planning efforts.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Large Ensemble Exploration of Global Energy Transitions Under National Emissions Pledges

Global climate goals require a transition to a deeply decarbonized energy system. Meeting the objectives of the Paris Agreement through countries' nationally determined contributions and long-term strategies represents a complex problem with consequences across multiple systems shrouded by deep uncertainty. Robust, large-ensemble methods and analyses mapping a wide range of possible future states of the world are needed to help policymakers design effective strategies to meet emissions reduction goals. This study contributes a scenario discovery analysis applied to a large ensemble of 5,760 model realizations generated using the Global Change Analysis Model. Eleven energy-related uncertainties are systematically varied, representing national mitigation pledges, institutional factors, and techno-economic parameters, among others. The resulting ensemble maps how uncertainties impact common energy system metrics used to characterize national and global pathways toward deep decarbonization. Results show globally consistent but regionally variable energy transitions as measured by multiple metrics, including electricity costs and stranded assets. Larger economies and developing regions experience more severe economic outcomes across a broad sampling of uncertainty. The scale of CO 2 removal globally determines how much the energy system can continue to emit, but the relative role of different CO 2 removal options in meeting decarbonization goals varies across regions. Previous studies characterizing uncertainty have typically focused on a few scenarios, and other large-ensemble work has not (to our knowledge) combined this framework with national emissions pledges or institutional factors. Our results underscore the value of large-ensemble scenario discovery for decision support as countries begin to design strategies to meet their goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Deep Learning with Physics Priors as Generalized Regularizers

In various scientific and engineering applications, there is typically an approximate model of the underlying complex system, even though it contains both aleatoric and epistemic uncertainties. In this paper, we present a principled method to incorporate these approximate models as physics priors in modeling, to prevent overfitting and enhancing the generalization capabilities of the trained models. Utilizing the structural risk minimization (SRM) inductive principle pioneered by Vapnik, this approach structures the physics priors into generalized regularizers. The experimental results demonstrate that our method achieves up to two orders of magnitude of improvement in testing accuracy.

Liu, Frank↗

DOE OSTI2024

Neural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Influence of data uncertainty on cold season threshold-based climate indices

Climate indices are used to reduce the complex climate system and its changes to simple measures. The data basis – whether observational data or climate model data – to which the climate indices are applied, is usually subject to uncertainties. For threshold-based climate indices, the data uncertainty influences the threshold value, and, hence, the uncertainty can influence the values for the climate index. What the actual impacts of these uncertainties are on threshold-based climate indices is examined in this paper. The focus is not only on the climate model uncertainty, but also on the observational data uncertainty. The general sensitivity of each of the chosen climate indices to arbitrary changes in the threshold is studied. This shows a higher sensitivity of indices assessing extremes (ice days, heavy precipitation days) to changes in the threshold than indices that integrate a quantity over a given time interval (coldsum, consecutive days). For assessing an ensemble of climate model data with respect to their ability to reproduce the index values for current climate, the reference data uncertainty is applied to the chosen threshold-based climate indices by changing their threshold value by its corresponding uncertainty. It is shown that the climate model uncertainty can be within the range of the reference data uncertainty. When using threshold-based climate indices to assess changes in future climate periods, uncertainties should always be taken into account and ideally corrected in an appropriate way. This is especially important for indices that assess extremes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Increased exposure of coastal cities to sea-level rise due to internal climate variability

Adaptation to future sea-level rise is based on projections of continuously improving climate models. These projections are accompanied by inherent uncertainties, including those due to internal climate variability (ICV). The ICV arises from complex and unpredictable interactions within and between climate-system components, rendering its impact irreducible. Although neglecting this uncertainty can lead to an underestimation of future sea-level rise, its estimation and impacts have not been fully explored. Combining the Community Earth System Model version 1 Large Ensemble experiments with power-law statistics, we show that, by 2100, if the ICV uncertainty reaches its upper limit, new sea-level-rise hotspots would appear in Southeast Asian megacities (Chennai, Kolkata, Yangon, Bangkok, Ho Chi Minh City and Manila), in western tropical Pacific Islands and the Western Indian Ocean. Here, the better the ICV uncertainty is taken into account and correctly estimated, the more effective adaptation strategies can be elaborated with confidence and actions to follow.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Uncertainty-Aware, Structure-Preserving Machine Learning Approach for Domain Shift Detection From Nonlinear Dynamic Responses of Structural Systems

Complex structural systems deployed for aerospace, civil, or mechanical applications must operate reliably under varying operational conditions. Structural health monitoring (SHM) systems help ensure the reliability of these systems by providing continuous monitoring of the state of the structure. SHM relies on synthesizing measured data with a predictive model to make informed decisions about structural states. However, these models—which may be thought of as a form of a digital twin—need to be updated continuously as structural changes (e.g., due to damage) arise. We propose an uncertainty-aware machine learning model that enforces distance preservation of the original input state space and then encodes a distance-aware mechanism via a Gaussian process (GP) kernel. The proposed approach leverages the spectral-normalized neural GP algorithm to combine the flexibility of neural networks with the advantages of GP, subjected to structure-preserving constraints, to produce an uncertainty-aware model. This model is used to detect domain shift due to structural changes that cannot be observed directly because they may be spatially isolated (e.g., inside a joint or localized damage). This work leverages detection theory to detect domain shift systematically given statistical features of the prediction variance produced by the model. The proposed approach is demonstrated on a nonlinear structure being subjected to damage conditions. In conclusion, it is shown that the proposed approach is able to rely on distances of the transformed input state space to predict increased variance in shifted domains while being robust to normative changes.

Algorithms↗

DOE OSTI2024

Advances on CHP District Energy and Microgrids Deployment: Simplified Tool for Rapidly Deploying Feasibility Analytics for the Non-Technical User (Final Technical Report)

Community energy systems have proven to have the potential to improve cost efficiency, resilience, and decarbonize. However, investing in community energy systems such as community microgrids or district energy systems is a complex decision due to the high initial investment and the uncertainties associated with the long development time and lifecycle of the project. Tools that make feasibility assessments accessible to non-technical users like investors, policymakers, and other stakeholders will result in more feasibility analyses completed, more candidate projects identified, and more community energy systems deployed. The pilot tool developed under this award is named Energy Fellow. Energy Fellow allows technical and non-technical users to complete feasibility analyses for district energy systems and community microgrids. This is the first software tool of its kind designed for non-technical users and available at no cost. Its scope was adjusted to a 25x25-mile region within the Houston area in Texas to make its development compatible with the funding available. However, the findings and models developed make this pilot tool easily scalable to the US. The lessons learned during the design, implementation, and testing stages have helped find trade-off solutions to software and hardware challenges related to implementing 3D models in online tools. Green software strategies has been successfully applied to the design and operations of the tool, and the team has researched the aspects of the (non-technical) user experience that will make commercial developments of this tool even more impactful.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

A variance deconvolution estimator for efficient uncertainty quantification in Monte Carlo radiation transport applications

Monte Carlo simulations are at the heart of many high-fidelity simulations and analyses for radiation transport systems. As is the case with any complex computational model, it is important to propagate sources of input uncertainty and characterize how they affect model output. Unfortunately, uncertainty quantification (UQ) is made difficult by the stochastic variability that Monte Carlo transport solvers introduce. The standard method to avoid corrupting the UQ statistics with the transport solver noise is to increase the number of particle histories, resulting in very high computational costs. In this contribution, we propose and analyze a sampling estimator based on the law of total variance to compute UQ variance even in the presence of residual noise from Monte Carlo transport calculations. Here, we rigorously derive the statistical properties of the new variance estimator, compare its performance to that of the standard method, and demonstrate its use on neutral particle transport model problems involving both attenuation and scattering physics. We illustrate, both analytically and numerically, the estimator’s statistical performance as a function of available computational budget and the distribution of that budget between UQ samples and particle histories. We show analytically and corroborate numerically that the new estimator is unbiased, unlike the standard approach, and is more accurate and precise than the standard estimator for the same computational budget.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Advancing uncertainty characterization for understanding projected water scarcity in multi-sector, multi-actor river basins across scales.

Invited Talk at AGU Fall Meeting 2023 Modeling how human institutions and infrastructure interact with the water cycle is essential to better understand the vulnerability, and resilience of water resources systems from the local to the global scale. This is especially true when investigating multi-sector, multi-actor responses to the effects of long-term changes and short-term shocks. It is also well recognized that uncertainty present throughout the modeling cycle (e.g., in data, functional relations, and model coupling approaches) limits our ability to trace the interactive dynamics of human-water systems, as well as to quantify their implications for management and planning. Systems with large numbers of diverse stakeholders further compound this challenge, as uncertain drivers and complex dynamics might have very disparate effects on water users. The work presented is conducted through the Integrated Multisector Multiscale Modeling (IM3) Science Focus Area, which explores how human and natural systems co-evolve in response to change. Through this multi-year effort, we have developed exploratory modeling methods to better characterize how the uncertain human and natural drivers of water scarcity yield consequential vulnerabilities in institutionally complex, multi-sectoral systems. This talk will specifically present on a series of uncertainty characterization experiments performed in the Upper Colorado River Basin, a sub-basin of the Colorado with thousands of water users. These complementary and systematic experiments are aimed at understanding: How are various uncertain stressors (e.g., climate change, demand growth) affecting the diverse water users of this basin in terms of water shortage? What are the key drivers of this shortage for each user? Methods and results from this work are used to address additional questions on the ability of adaptation to modulate the effects of these uncertain drivers, and on their compounding effects across spatial scales and through sectoral interactions.

Hadjimichael, Antonia↗

DOE OSTI2025

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Infrastructure first principles for the Anthropocene

Abstract There appears to be a growing decoupling between the conditions that infrastructures were designed for and today’s rapidly changing environments. Infrastructures today are largely predicated on the technologies, goals, and governance structures from a century ago. While infrastructures continue to deliver untold value, there is growing evidence that these critical, basic, and lifeline systems appear ill-equipped to confront the volatility, uncertainty, accelerating conditions, and complexity that define them and their changing environments. Innovative and disruptive first principles are needed to guide infrastructures in the Anthropocene. Drawing from emerging infrastructure research and disciplines that appear better able to confront disruption and change, a novel set of first principles are identified: (1) Plan for complex conditions and surprise; (2) Recouple with agility and flexibility; (3) Govern for exploration and instability; (4) Build consensus as control decentralizes; (5) Restructure to engage with porous boundaries; and, (6) Cyberthreat planning is now mission critical. These principles should guide infrastructure planning recognizing the changing nature and increasingly obsolete boundaries that have defined engineered systems in the modern era.

Chester, Mikhail (ORCID:0000000293542102)↗