Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty in complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Infrastructure first principles for the Anthropocene

Abstract There appears to be a growing decoupling between the conditions that infrastructures were designed for and today’s rapidly changing environments. Infrastructures today are largely predicated on the technologies, goals, and governance structures from a century ago. While infrastructures continue to deliver untold value, there is growing evidence that these critical, basic, and lifeline systems appear ill-equipped to confront the volatility, uncertainty, accelerating conditions, and complexity that define them and their changing environments. Innovative and disruptive first principles are needed to guide infrastructures in the Anthropocene. Drawing from emerging infrastructure research and disciplines that appear better able to confront disruption and change, a novel set of first principles are identified: (1) Plan for complex conditions and surprise; (2) Recouple with agility and flexibility; (3) Govern for exploration and instability; (4) Build consensus as control decentralizes; (5) Restructure to engage with porous boundaries; and, (6) Cyberthreat planning is now mission critical. These principles should guide infrastructure planning recognizing the changing nature and increasingly obsolete boundaries that have defined engineered systems in the modern era.

Chester, Mikhail (ORCID:0000000293542102)↗
DOE OSTI2021

Analysis of secondary organic aerosol simulation bias in the Community Earth System Model (CESM2.1)

Organic aerosol (OA) has been considered as one of the most important uncertainties in climate modeling due to the complexity in presenting its chemical production and depletion mechanisms. To better understand the capability of climate models and probe into the associated uncertainties in simulating OA, we evaluate the Community Earth System Model version 2.1 (CESM2.1) configured with the Community Atmosphere Model version 6 (CAM6) with comprehensive tropospheric and stratospheric chemistry representation (CAM6-Chem) through a long-term simulation (1988–2019) with observations collected from multiple datasets in the United States. We find that CESM generally reproduces the interannual variation and seasonal cycle of OA mass concentration at surface layer with a correlation of 0.40 compared to ground observations and systematically overestimates (69%) in summer and underestimates (-19%) in winter. Through a series of sensitivity simulations, we reveal that modeling bias is primarily related to the dominant fraction of monoterpene-formed secondary organic aerosol (SOA), and a strong positive correlation of 0.67 is found between monoterpene emission and modeling bias in the eastern US during summer. In terms of vertical profile, the model prominently underestimates OA and monoterpene concentrations by 37%–99% and 82%–99%, respectively, in the upper air (>500 m) as validated against aircraft observations. Our study suggests that the current volatility basis set (VBS) scheme applied in CESM might be parameterized with monoterpene SOA yields that are too high, which subsequently results in strong SOA production near the emission source area. We also find that the model has difficulty in reproducing the decreasing trend of surface OA in the southeastern US probably because of employing pure gas VBS to represent isoprene SOA which is in reality mainly formed through multiphase chemistry; thus, the influence of aerosol acidity and sulfate particle change on isoprene SOA formation has not been fully considered in the model. This study reveals the urgent need to improve the SOA modeling in climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

On the characterization of biases arising from methods and approximations used for sensitivity analyses

The preliminary assessment of the performance and safety of advanced reactors, as well as the identification of research and development needs, rely on computer simulations due to the lack of operational experience. Those simulations should be based on verified and validated computational tools, calculation schemes, and nuclear data libraries, and should be accompanied of a proper characterization of the involved uncertainties, providing confidence in the computational-based predictions. Thus, sensitivity and uncertainty studies, together with integral experiments, play an essential role in that process. Sensitivities are then a critical element and guidelines about how to produce accurate enough sensitivities depending on the subsequent analyses to be performed are of interest. The present study addresses the sensitivities biases arising from the use of different nuclear data libraries, computational methods and the assumption of modelling simplifications. Not only sensitivities for multiplication factor but also for safety-relevant reactivity responses have been analyzed. In the study, propagated uncertainties are also included for the considered parameters to illustrate the impact of the sensitivity profiles obtained for each case on the final uncertainty. Then, relevant recommendations are given for sensitivity analyses of highly complex systems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

A Hybrid Stochastic-Interval Operation Strategy for Multi-Energy Microgrids

Increasing deployment of distributed energy resources intensifies interactions among electric, gas, heating, and cooling systems. Inherent uncertainties ranging from internal parameters to external inputs also impose significant challenges on system operation. A coordinated scheduling method is, therefore, desired for facilitating efficient operation of multi-energy microgrids under multiple uncertainties. In this paper, a deterministic coordinated scheduling model is developed first with detailed modeling of system dynamics and device parameters to fully characterize complex interactions among multi-energy carriers. Then, a hybrid stochastic-interval method is proposed to account for heterogeneous uncertainties in decisions of operational strategies. Specifically, performance and efficiency uncertainties of distributed energy resources, and injection uncertainty of renewable sources and multienergy demands are characterized by interval-based uncertain operation regions and probability distributions, respectively. A scenario-based two-stage algorithm is developed to solve the problem so that multiple uncertainties are preserved in the entire decision-making process. Moreover, adjustable operational strategies are determined to hedge uncertainty by considering operators’ risk preferences. The validity of the proposed method is verified by comprehensive case studies on a test system.

hybrid stochastic-interval approach↗
DOE OSTI2021

Modular hybrid modeling to increase efficiency, explore structural uncertainty, and allow multidimensional complexity scaling in land surface models

Land surface models (LSMs) are indispensable tools for predicting hydrologic extremes, as well as a particularly uncertain component of Earth system models that has stubbornly resisted the convergence in projections over several successive generations of model intercomparisons. This uncertainty in LSMs is poorly quantified and poorly attributed to specific processes, which has hampered efforts to focus research in reducing uncertainty. This has resulted from sparse sampling of the possible uncertainty space—which is high-dimensional and has contributions from parametric, structural, initial, and boundary condition uncertainties—as an artifact of CMIP-type ensembles of opportunity and limitations inherent in observational benchmarks. A new approach is needed to understand and reduce this uncertainty, based around individual LSMs that can represent the breadth of assumptions represented in current CMIP-type efforts, while at the same time exploring that uncertainty in a systematic way, confronting multiple types of observations, and where justified, replacing process representations with ML-driven emulators. We propose an approach of modular hybrid modeling to address these challenges.

58 GEOSCIENCES↗
DOE OSTI2023

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗
DOE OSTI2021

A REDUCED ORDER MODELING APPROACH TO PROBABILISTIC CREEP-DAMAGE PREDICTIONS IN FINITE ELEMENT ANALYSIS

This paper introduces a computationally efficient Reduced Order Modeling (ROM) approach for the probabilistic prediction of creep-damage failure. Component-level probabilistic simulations are needed to assess the reliability and safety of high-temperature components. Full-scale probabilistic creep-damage modeling in finite element (FE) approach is computationally expensive requiring many hundreds of simulations to replicate the uncertainty of component failure. To that end, ROM is proposed to minimize the elevated computational cost while controlling the loss of accuracy. It is proposed that full-scale probabilistic simulations can be completed in 1D at a reduced cost, the extremum conditions extracted, and those conditions applied for lower-cost 2D/3D probabilistic simulations of components that capture the mean and uncertainty of failure. The probabilistic Sine-hyperbolic (Sinh) model is selected which in previous work was calibrated to alloy 304 stainless steel. The Sinh model includes probability density functions (pdfs) for test condition (stress and temperature), initial damage (i.e. microstructure), and material properties uncertainty. The Sinh model is programmed into ANSYS finite element software using the USERCREEP.F material subroutine. First, the Sinh model and FE code are subject to verification and validation to ensure the accuracy of the simulations. Numerous Monte Carlo simulations are executed in a 1D model to generate probabilistic creep deformation, damage, and rupture data. This data is analyzed and the probabilistic parameters corresponding to extreme creep response are extracted. The ROM concept is applied where only the extreme conditions are applied in the 2D probabilistic prediction of a component. The probabilistic predictions between the 1D and 2D geometry is compared to assess ROM for creep. The accuracy of the probabilistic prediction employing the ROM approach will potentially reduce the time and cost of simulating complex engineering systems. Future studies will introduce multi-stage Sinh, stochasticity, and spatial uncertainty for improved prediction.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Wildfire Smoke Demonstrates Significant and Predictable Black Carbon Light Absorption Enhancements

Abstract Black carbon (BC) is estimated to have the second largest anthropogenic radiative forcing in earth‐systems models (ESMs), but there is significant uncertainty in its impact due to complex mixing with organics. Laboratory‐generated particles show that co‐mixed non‐absorbing material enhances absorption by BC by a factor of 2–3.5 as predicted by optical models. However, weak or no enhancements are often reported for field studies. The cause of lower‐than‐expected absorption is not well understood and implies a lower radiative impact of BC compared to how many ESMs currently treat aerosols. By analyzing BC aerosol particle‐by‐particle we reconcile observed and expected absorption for ambient smoke plumes varying in geographic origin, fuel types, burn conditions, atmospheric age and transport. Although particle‐by‐particle tracking is computationally prohibitive for sophisticated ESMs we show that realistic BC absorption is reliably estimated by bulk properties of the plume providing a suitable parameterization to constrain black carbon radiative forcing.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty Quantification for Component Modeling Using the Discrete-Direct Approach

Threaded fastener behavior can be an important aspect of complex component and system behavior, but there is no one-size-fits-all finite element analysis technique. Proper modeling of threaded fastener joints requires careful consideration of many details, from test setup and data acquisition to constitutive modeling and uncertainty quantification approaches. This report details analysis of a “mini-radax” bolted-joint exemplar where a Discrete-Direct uncertainty quantification approach is employed to evaluate margin of the component. The mini-radax geometry is tested to failure on a drop table, and single-coupon tests of individual fasteners serve as foundational data for the analysis. Analysis predictions complement the test data well and provide additional context for engineering decision-making.

42 ENGINEERING↗
DOE OSTI2023

Introduction to the Special Section on Control and Management of Electric Power Systems With High Shares of Inverter-Based Resources

The growing interest in the integration of variable renewable energy (VRE) and distributed energy resources (DER) on both policy and economic grounds is driving the transformation of electric power systems. The significant deployment of VRE and DER can effectively displace the conventional synchronous generator-based power plants that for decades have been the foundation for power system generation and stability in electric power systems. Inverter-based resources (IBRs) introduce a high-level of uncertainty, variability, and complexity into the operation of electric power networks, and the transformation to IBRs raises a wide range of technical questions and operational challenges. The optimal coordination and control of these resources requires greater interoperability and necessitates significant upgrades of grid automation, including real-time monitoring.

distributed power generation↗
DOE OSTI2022

A new multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential processes under process model and parametric uncertainty

Process-based models have been widely used for hydrologic modeling, and it is a common practice to use sensitivity analysis methods for excluding non-influential hydrologic processes from further investigation and/or model improvement. This study develops a new method called multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential system processes and parameters. MMADS is conceptually similar to the Morris method for addressing parametric uncertainty, but has a unique feature to address both process model uncertainty (i.e., a process may be represented by multiple process models) and process model parameter uncertainty (i.e., parameters associated with a process model are random). MMADS first evaluates absolute differences of a quantity of interest (i.e., a system model output) by varying process models and/or process model parameter values, and then calculates the mean and variance of the differences for investigating process influence. The mean measures overall influence of the process on the quantity of interest, and the variance estimates influence of nonlinear effects of the process and/or its interactions with other processes. MMADS is an extension of the Morris method from a parameter space to a joint parameter-model space for explicitly addressing both process model uncertainty and model parameter uncertainty. The performance of MMADS is evaluated by using two numerical experiments. One experiment is based on Sobol’s G*-function with ten product elements, and has analytical solutions of the MMADS mean and variance of absolute differences. The other experiment is for groundwater flow modeling which considers three processes (i.e., recharge, geology, and snowmelt) that interact with each other. Finally, results indicate that MMADS is computationally efficient and can identify non-influential processes of complex hydrological systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling

Abstract. Uncertainties in an output of interest that depends on the solution of a complex system (e.g., of partial differential equations with random inputs) are often, if not nearly ubiquitously, determined in practice using Monte Carlo (MC) estimation. While simple to implement, MC estimation fails to provide reliable information about statistical quantities (such as the expected value of the output of interest) in application settings such as climate modeling, for which obtaining a single realization of the output of interest is a costly endeavor. Specifically, the dilemma encountered is that many samples of the output of interest have to be collected in order to obtain an MC estimator that has sufficient accuracy – so many, in fact, that the available computational budget is not large enough to effect the number of samples needed. To circumvent this dilemma, we consider using multifidelity Monte Carlo (MFMC) estimation which leverages the use of less costly and less accurate surrogate models (such as coarser grids, reduced-order models, simplified physics, and/or interpolants) to achieve, for the same computational budget, higher accuracy compared to that obtained by an MC estimator – or, looking at it another way, an MFMC estimator obtains the same accuracy as the MC estimator at lower computational cost. The key to the efficacy of MFMC estimation is the fact that most of the required computational budget is loaded onto the less costly surrogate models so that very few samples are taken of the more expensive model of interest. We first provide a more detailed discussion about the need to consider an alternative to MC estimation for uncertainty quantification. Subsequently, we present a review, in an abstract setting, of the MFMC approach along with its application to three climate-related benchmark problems as a proof-of-concept exercise.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Representing Socio‐Economic Uncertainty in Human System Models

Abstract Socio‐economic development pathways and their implications for the environment are highly uncertain, and energy transitions will involve complex interactions among sectors. Here, traditional Monte Carlo analysis is paired with scenario discovery techniques to provide a richer portrait of these complexities. Modeled uncertain input variables include costs of advanced energy technologies, energy efficiency trends, fossil fuel resource availability, elasticities of substitution for labor, capital, and energy across economic sectors, population growth, and labor and capital productivity. The sampled values are simulated through a multi‐sector, multi‐region, recursively dynamic model of the world economy to explore a range of possible future outcomes. We find that many patterns of energy and technology development are possible for various long‐term environmental pathways and that sectoral output for most sectors is little affected through 2050 by the long‐term temperature target, but with tight constraints on emissions, emission intensities must fall much more rapidly. Scenario discovery techniques are applied to the large uncertainty ensembles to explore if there are prevailing storylines behind outcomes of interest. An illustrative investigation focused on different levels of economic growth shows many combinations of pathways and no single storyline emerging for a given economic outcome. This method can be extended to other outcomes of interest, exploring the nature of scenarios with both tail and median outcomes. Sampling from a Monte Carlo generated ensemble provides a rich set of scenarios to investigate, and potentially aids in avoiding heuristic biases in less structured scenario approaches.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Theoretical uncertainty quantification for heavy-ion fusion

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. Furthermore, these large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

A theoretical study on quasifission and fusion–fission processes in heavy-ion collisions

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. These large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Composite Power System Reliability with Renewables and Customer Flexibility

Composite Power System Reliability is defined as the computational procedure that quantifies the probability that the power system will perform the function of delivering electric power to customers adequately, on a continuous basis and with an acceptable quality. This definition leaves many details undefined and exemplifies the ambiguity in reliability analysis. The increasing deployment of wind and PV creates additional uncertainties that make reliability analysis a rather complex issue. Because of increased uncertainty the need for composite reliability analysis and utilization of results in power system planning is critical. New approaches are emerging for dealing with these problems from the operational point of view, including demand response programs, tapping on customer and distributed resource flexibility and new control approaches. The key question to be addressed is: how the new operational paradigms affect composite power system reliability. Here, this paper presents the ongoing work of the IEEE Composite System Reliability Task Force of the IEEE PES Reliability, Risk, Probability Application (RRPA) Subcommittee.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗