Chance-constrained co-optimization of demand response and Volt/Var under Gaussian mixture model uncertainty
Not Available
Najafi, Soroush (ORCID:0009000423286803)↗
SEARCH · Search NASA
Results for “Optimization Under Uncertainty”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Ligand Many-Body Expansion as a General Approach for Accelerating Transition Metal Complex Discovery
Methods that accelerate the evaluation of molecular properties are essential for chemical discovery. While some degree of ligand additivity has been established for transition metal complexes, it is underutilized in asymmetric complexes, such as the square pyramidal coordination geometries highly relevant to catalysis. To develop predictive methods beyond simple additivity, we apply a many-body expansion to octahedral and square pyramidal complexes and introduce a correction based on adjacent ligands (i.e., the cis interaction model). We first test the cis interaction model on adiabatic spin-splitting energies of octahedral Fe(II) complexes, predicting DFT-calculated values of unseen binary complexes to within an average of 1.4 kcal/mol. Uncertainty analysis reveals the optimal basis, comprising the homoleptic and mer symmetric complexes. We next show that the cis model (i.e., the cis interaction model solved for the optimal basis) infers both DFT- and CCSD(T)-calculated model catalytic reaction energies to within 1 kcal/mol on average. The cis model predicts low-symmetry complexes with reaction energies outside the range of binary complex reaction energies. We observe that trans interactions are unnecessary for most monodentate systems but can be important for some combinations of ligands, such as complexes containing a mixture of bidentate and monodentate ligands. Lastly, we demonstrate that the cis model may be combined with Δ-learning to predict CCSD(T) reaction energies from exhaustively calculated DFT reaction energies and the same fraction of CCSD(T) reaction energies needed for the cis model, achieving around 30% of the error from using the CCSD(T) reaction energies in the cis model alone.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Machine Learning for Optimized Polarization at Jefferson Lab
Polarized cryo-targets and polarized photon beams are widely used in experiments at Jefferson Lab. Traditional methods for maintaining the optimal polarization involve manual adjustments throughout data taking by human shift takers. This may introduce some level of inconsistency simply due to the wide variety of experience and expertise of the shift takers themselves. Implementing machine learning-based control systems can improve the stability of the polarization without relying on human intervention. The cryo-target polarization is influenced by temperature, microwave energy, the distribution of paramagnetic radicals, as well as operational conditions including the radiation dose. Diamond radiators are used to generate linearly polarized photons from a primary electron beam. The energy spectrum of these photons can drift over time due to changes in the primary electron beam conditions and diamond degradation. As a first step towards automating the continuous optimization and control processes, uncertainty aware surrogate models have been developed to predict the polarization based on historical data. This talk will provide an overview of the use cases and models developed, highlighting the collaboration between data scientists and physicists at Jefferson Lab.
Jeske, Torri [Thomas Jefferson National Accelerato↗
Accelerating Scientific Simulations with Bi-Fidelity Weighted Transfer Learning
High-fidelity modeling is an essential design tool for many engineering applications. However, for complex systems, computational cost can be a limiting factor. Analyzing parameter sensitivity, uncertainty quantification, and design optimization require many model evaluations. Surrogate models are often used to develop the relationship between model parameters and quantities of interest. However, in the case of complex systems, surrogate models require several degrees of freedom and, thus, a large number of data points to determine the correct dependencies. For many applications, this may be prohibitively expensive. The reduction of computational requirements can be achieved by leveraging low-fidelity models. Low-fidelity models represent the system at a coarser resolution with the advantage of computational efficiency. Therefore, a bi-fidelity modeling paradigm, which augments the accuracy of a low-fidelity model in a computationally efficient manner by invoking limited runs of a high-fidelity model, can be leveraged to sufficiently balance the accuracy and computational requirements. In this work, a bi-fidelity weighted transfer learning method using neural networks was applied to a computational fluid dynamics heat transfer modeling problem. The transfer learning advantage was investigated as a function of hyperparameters. Our main finding is that the use of a bi-fidelity modeling paradigm achieves accuracy close to that of a high-fidelity Gaussian process model while significantly reducing computational cost. The bi-fidelity model achieves comparable performance with 90 high-fidelity samples-that is, 60% less than the samples needed to achieve similar accuracy without the use of bi-fidelity modeling,
Borowiec, Katarzyna↗
Learning error distribution kernel‐enhanced neural network methodology for multi‐intersection signal control optimization
Traffic congestion has substantially induced significant mobility and energy inefficiency. Many research challenges are identified in traffic signal control and management associated with artificial intelligence (AI)-based models. For example, developing AI-driven dynamic traffic system models that accurately capture high-resolution traffic attributes and formulate robust control algorithms for traffic signal optimization is difficult. Additionally, uncertainties in traffic system modeling and control processes can further complicate traffic signal system controllability. To partially address these challenges, this study presents a novel, hybrid neural network model enhanced with a probability density function kernel shaping technique to formulate traffic system dynamics better and improve comprehensive traffic network modeling and control. The numerical experimental tests were conducted, and the results demonstrate that the proposed control approach outperforms the baseline control strategies and reduces overall average delays by 11.64% on average. By leveraging the capabilities of this innovative model, this study aims to address major challenges related to traffic congestion and energy inefficiency toward more effective and adaptable AI-based traffic control systems.
Wang, Hong [Oak Ridge National Laboratory (ORNL), ↗
Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference
In this work, we present two neural network approaches that approximate the solutions of static and dynamic conditional optimal transport (COT) problems. Both approaches enable conditional sampling and conditional density estimation, which are core tasks in Bayesian inference—particularly in the simulation-based (“likelihood-free”) setting. Our methods represent the target conditional distribution as a transformation of a tractable reference distribution. Obtaining such a transformation, chosen here to be an approximation of the COT map, is computationally challenging even in moderate dimensions. To improve scalability, our numerical algorithms use neural networks to parameterize candidate maps and further exploit the structure of the COT problem. Our static approach approximates the map as the gradient of a partially input convex neural network. It uses a novel numerical implementation to increase computational efficiency compared to state-of-the-art alternatives. Our dynamic approach approximates the conditional optimal transport via the flow map of a regularized neural ODE; compared to the static approach, it is slower to train but offers more modeling choices and can lead to faster sampling. We demonstrate both algorithms numerically, comparing them with competing state-of-the-art approaches, using benchmark datasets and simulation-based Bayesian inverse problems.
97 MATHEMATICS AND COMPUTING↗
Mathematical nuances of Gaussian process-driven autonomous experimentation
Abstract The fields of machine learning (ML) and artificial intelligence (AI) have transformed almost every aspect of science and engineering. The excitement for AI/ML methods is in large part due to their perceived novelty, as compared to traditional methods of statistics, computation, and applied mathematics. But clearly, all methods in ML have their foundations in mathematical theories, such as function approximation, uncertainty quantification, and function optimization. Autonomous experimentation is no exception; it is often formulated as a chain of off-the-shelf tools, organized in a closed loop, without emphasis on the intricacies of each algorithm involved. The uncomfortable truth is that the success of any ML endeavor, and this includes autonomous experimentation, strongly depends on the sophistication of the underlying mathematical methods and software that have to allow for enough flexibility to consider functions that are in agreement with particular physical theories. We have observed that standard off-the-shelf tools, used by many in the applied ML community, often hide the underlying complexities and therefore perform poorly. In this paper, we want to give a perspective on the intricate connections between mathematics and ML, with a focus on Gaussian process-driven autonomous experimentation. Although the Gaussian process is a powerful mathematical concept, it has to be implemented and customized correctly for optimal performance. We present several simple toy problems to explore these nuances and highlight the importance of mathematical and statistical rigor in autonomous experimentation and ML. One key takeaway is that ML is not, as many had hoped, a set of agnostic plug-and-play solvers for everyday scientific problems, but instead needs expertise and mastery to be applied successfully. Graphical abstract
97 MATHEMATICS AND COMPUTING↗
Black-Box Neural System Identification and Differentiable Programming to Improve Earth System Model Predictions February
Focal Area(s): Focal Area 2: AI for predictive modeling, including AI-derived model components, and AI-enabled applications including parameter optimization, data assimilation, and uncertainty quantification. Focal Area 1: AI-assisted data assimilation using numerical Earth system models. Science Challenge: Earth system models have structural biases that lead to uncertain predictions, and their complexity and expense makes it difficult constraining the models with data or improved physical understanding.
54 ENVIRONMENTAL SCIENCES↗
Hypercomplex Automatic Differentiation in the Eulerian Hydrocode PAGOSA
Enabling the computation of partial derivatives or sensitivities in production hydrocodes is beneficial for design, optimization, sensitivity analysis, and uncertainty quantification. Traditional finite difference approximations of these sensitivities are inefficient since convergence studies of the step size is required for each parameter of interest. For these reasons, HYPercomplex Automatic Differentiation (HYPAD) was implemented in the Eulerian hydrocode PAGOSA. HYPAD is analogous to forward-mode automatic differentiation except hypercomplex numbers (numbers with multiple imaginary parts) are used instead of dual numbers. Accurate partial derivatives can be computed of all state variables with respect to multiple input variables in a single run. The method was implemented using operator overloading to handle hypercomplex algebra. HYPAD was demonstrated and verified on Sod’s shock tube problem to compute derivatives of the state variables with respect to a material parameter, initial conditions, and geometry.
97 MATHEMATICS AND COMPUTING↗
Data and Multistage Optimization for the New Grid
Three essential capabilities for using exascale computing resources on next generation power grid applications are: generating large renewable energy datasets, modeling damage and operations during and after extreme events, and employing multi-stage optimization for infrastructure planning. Powerscenarios, developed as part of the ExaSGD project, addresses these capabilities by enabling users to build synthetic wind farms for large test systems using numerical weather prediction-based data sources. We share examples of using Powerscenarios to build out wind farms on the ACTIVSg2000 test system, to enable simulated operations and emergency asset allocation during a hurricane strike, and to compute multi-stage infrastructure buildouts.
economic dispatch↗
Evolution of Scenario Generation Capabilities in the ExaSGD Project
High-fidelity renewable energy scenarios and rare-event high-impact contingencies are essential for modeling operations and infrastructure expansion of the next generation power grids using exascale computing resources. As the ExaSGD project progressed, our capabilities for generating scenarios for modeling wind power output at multiple wind farms significantly improved, evolving from the use of independent random perturbations to importance sampling-based techniques capturing representative spatial-temporal relations. Contingency generation also improved, evolving from standard N-1 techniques to probabilistic models of infrastructure damage resulting from extreme weather events. We review the developments in the realistic intermittent-energy scenario forecasting and extreme-event contingency creation as the ExaSGD project progressed and discuss the future work in these areas.
economic dispatch↗
Final Report (October 2024): University of Tennessee, Knoxville (UTK) contribution to: FusMatML: Machine Learning Atomistic Modeling for Fusion Materials Collaborative Project led by Dr. Aidan Thompson, Sandia National Laboratory
The rapid growth of the field of Machine Learning Inter-Atomic Potentials (MLIAP) has lead to a profusion of methods, all of which have some similarity to each other, but each also restricted to particular design choices, often arrived at in a rather ad hoc fashion. Beyond anecdotal evidence, and some benchmarking studies on specific problems, little progress has been made in developing design principles for MLIAPs. The goal of this project is to use machine learning, data science, and uncertainty quantification methods to optimize the design choices for MLIAP.
Density functional theory, Helium and Hydrogen↗
Dynamic Transmission Line Switching Amid Wildfire-Prone Weather Under Decision-Dependent Uncertainty
During dry and windy seasons, environmental conditions significantly increase the risk of wildfires, exposing power grids to disruptions caused by transmission line failures. Wildfire propagation exacerbates grid vulnerability, potentially leading to prolonged power outages. To address this challenge, we propose a multistage optimization model that dynamically adjusts transmission grid topology in response to wildfire propagation, aiming to develop an optimal response policy. By accounting for decision-dependent uncertainty, where line survival probabilities depend on usage, we employ distributionally robust optimization to model uncertainty in line survival distributions. We adapt the stochastic nested decomposition algorithm and derive a deterministic upper bound for its finite convergence. To enhance computational efficiency, we exploit the Lagrangian dual problem structure for a faster generation of Lagrangian cuts. Using realistic data from the California transmission grid, we demonstrate the superior performance of dynamic response policies against two-stage alternatives through a comprehensive case study. In addition, after solving the multistage formulation, we construct easy-to-implement policies that significantly reduce computational burden while maintaining good performance in real-time deployment. History: Accepted by Russell Bent, Area Editor for Network Optimization: Algorithms and Applications. Funding: This work was supported by the U.S. Department of Energy, Office of Electricity [Grant DE-AC02-05CH11231]. The work of R. Jiang was supported in part by the U.S. National Science Foundation, Division of Electrical, Communications and Cyber Systems [Grant ECCS-1845980] and the U.S. Air Force Office of Scientific Research [Grant FA9550-23-1-0323]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2025.1210 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2025.1210 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .
Estrada-Garcia, Juan-Alberto↗
A high-throughput approach for statistical process optimization in Laser Powder Bed Fusion
Process variability is inherent in metal additive manufacturing (AM). However, it is often overlooked in process optimization frameworks, constraining the understanding of process uncertainties and their influence on parameter selection. To address this, we present an integrated framework that combines high-throughput single-track experiments, GAN-based melt pool geometry extraction, robust statistical and machine learning modeling, and uncertainty-quantified process mapping. Process variability is characterized through single-track melt pool behaviors, and its influence on defect formation is systematically quantified to enable statistically guided process parameter optimization. This approach is demonstrated on Laser Powder Bed Fusion (L-PBF) of stainless steel 316L, effectively capturing the interplay between process parameters, melt pool variability, and defect probability. By integrating uncertainty quantification into process optimization, this study provides a structured methodology for addressing variability challenges in AM quality control, ultimately contributing to enhanced manufacturing reliability.
Laser Powder Bed Fusion↗
Design, Optimization, and Control of Floating Offshore Wind Farms for Optimal Energy Production (Final report)
The uncertainty and irregularity of ocean waves and the ocean environment is a major factor in the development of commercial scale floating wind turbines as the operation of floating structures in such an environment can lead to irregular and unpredictable loading, fatigue, and ultimately a reduction in the operational life of the turbine system which affects energy production over the lifetime of the turbine. Control solutions that can limit float motions and mitigate stressful events on the structure become essential for extending lifetime and limiting the operational uncertainty of a floating wind turbine. Digital twins are computational replicas of physical systems that operate in parallel with the operation of the physical system. Given advanced knowledge of a systems input, digital twins have the ability to predict the behavior of a system in advance, which can be valuable in the control of that system. In this project, we developed and assessed potential digital twin models developed in house and openly available (OpenFast) for use in the real time control of the six degree of freedom response motions of a floating wind turbine in ocean waves. Coupling these models with near-field real time irregular sea surface (wve) measurement/sensings and prediction models, we used the digital twin to predict how the floating turbine will respond to the incoming waves. Applying this information to a motion control system of the float, one can limit and control float motions to prevent undesirable loading events/large angular motions, thus increasing system life and ultimately contributing to optimizing energy production. Due to the computational intensity of operating a digital twin in real time, we investigated the use of artificial intelligence techniques to speed-up the processes of the digital twin, as well as the wave reconstruction/prediction models. Model tank testing at the University of Rhode Island and University of Maine both validated and demonstrated the developed techniques on simple float geometries and a scale model of the NREL 15 MW reference turbine.
17 WIND ENERGY↗
Multi-Timescale Optimal Operation Framework for Integrated Economic and Reliability Analysis of Hybrid Power Plants
This paper introduces a hierarchical modeling framework for hybrid power plants (HPP) to facilitate the operation of HPP in power systems similar to conventional generators (Congens) in the integrated multi-timescale optimal operation framework. To consider the uncertainties of HPP renewable power in the day-ahead scheduling, distributionally robust optimization (DRO) is used. To ensure that the state-of-charge (SOC) of energy storage systems in HPPs aligns closely with the planned value for long-term reliability, real-time SOC management is incorporated. In addition, an adjustable real-time control is designed for the robust delivery of HPP real-time services. Case studies performed on a revised IEEE 39-bus system demonstrate the effectiveness of the proposed framework for HPP operation. Simulation results highlight that the proposed framework not only can help operators schedule HPP similar to Congens in varying weather conditions but can also maintain the frequency reliability of the system.
frequency stability↗
ETHOS: An automated framework to generate multi-fidelity constitutive data tables and propagate uncertainties to hydrodynamic simulations
Accurate constitutive data, such as equations of state and plasma transport coefficients, are necessary for reliable hydrodynamic simulations of plasma systems such as fusion targets, planets, and stars. Here, we develop a framework for automatically generating transport-coefficient tables using a parameterized model that incorporates data from both high-fidelity sources (e.g., density functional theory calculations and reference experiments) and lower-fidelity sources (e.g., average-atom and analytic models). The framework incorporates uncertainties from these multi-fidelity sources, generating ensembles of optimally diverse tables that are suitable for uncertainty quantification of hydrodynamic simulations. We illustrate the utility of the framework with magnetohydrodynamic simulations of magnetically launched flyer plates, which are used to measure material properties in pulsed-power experiments. We explore how changes in the uncertainties assigned to the multi-fidelity data sources propagate to changes in simulation outputs and find that our simulations are most sensitive to uncertainties near the melting transition. The presented framework enables computationally efficient uncertainty quantification that readily incorporates new high-fidelity measurements or calculations and identifies plasma regimes where additional data will have high impact.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗