Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal Control Problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Towards constrained grid-forming control

Grid-forming converters are commonly envisioned to replace conventional synchronous generators as the cornerstone of future power systems. However, compared to synchronous generators, power converters and their power sources (e.g., renewable generation, energy storage) are subject to significant physical constraints (e.g., current limits, modulation limits). Grid-forming controls are commonly designed neglecting these constraints and subsequently augmented with limiters for a subset of constraints. In this work, we propose a systematic approach to constrained grid-forming control of two-level voltage source converters interfacing photovoltaics. We first formulate grid-forming control objectives and constraints of voltage source converters and photovoltaics in a one-step optimal grid-forming control problem. Next, we leverage primal-dual dynamics to obtain a dynamic feedback controller that approximates the solution of the one-step optimal grid-forming control problem. Finally, electromagnetic transient simulations are used to illustrate the results.

Gross, Dominic↗
DOE OSTI2022

Machine Learning with Gradient-Based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints

Gekko is an optimization suite in Python that solves optimization problems involving mixed-integer, nonlinear, and differential equations. The purpose of this study is to integrate common Machine Learning (ML) algorithms such as Gaussian Process Regression (GPR), support vector regression (SVR), and artificial neural network (ANN) models into Gekko to solve data based optimization problems. Uncertainty quantification (UQ) is used alongside ML for better decision making. These methods include ensemble methods, model-specific methods, conformal predictions, and the delta method. An optimization problem involving nuclear waste vitrification is presented to demonstrate the benefit of ML in this field. ML models are compared against the current partial quadratic mixture (PQM) model in an optimization problem in Gekko. GPR with conformal uncertainty was chosen as the best substitute model as it had a lower mean squared error of 0.0025 compared to 0.018 and more confidently predicted a higher waste loading of 37.5 wt% compared to 34 wt%. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches. Future works with these tools include expanding them with other regression models and UQ methods, and exploration into other optimization problems or dynamic control.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Bayesian optimization algorithms for accelerator physics

Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques toward solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Unifying Energy-Management Problems for Inverter-Based Power Networks

This paper outlines a suite of energy-management problems for inverter-based power networks from the vantage point of optimal control and (non)linear optimization. The problems are categorized based on timescales dictated by the network dynamics, and organized methodologically based on the problem complexity. A growing body of literature has addressed problems in this domain, albeit, with poorly motivated assumptions and behavioral models that obscure precise device behavior. With a combination of circuit- and control-theoretic lenses, we establish appropriate dynamic models for the networked resources, illustrate how common engineering assumptions arise, uncover how problems are linked, and postulate open challenges.

(non)linear optimization↗
DOE OSTI2020

Coastal Community Resiliency Enhancement Using Marine Hydrokinetic (MHK) Resources and Networked Microgrids

Enormous challenges are inherent in the operation of modern distribution grids. In particular, distribution feeders can be severely compromised under extreme conditions such as large-scale weather events (e.g., hurricanes, floods, and other types of natural disasters). To combat this problem, they turn to local energy support from distributed energy resources, such as solar and wind, marine hydrolinetic (MHK), and other types of energy. In this report, we investigate the actual characteristics of MHK resources to enhance coastal community resiliency. Two typical types of MHK resources (i.e., wave and tidal resources) illustrate the coastal resilience enhancement framework. By identifying their operational characteristics, such as target time-scales and potential power generation variations, we detail a holistic coastal community resiliency enhancement framework that integrates both optimization and control efforts. The optimization problem is formulated to significantly minimize the power outage time at the critical infrastructures in coastal communities by implementing multiple autonomous and dynamic microgrids around MHK resources. Therefore, during severe power outages caused by natural disasters (e.g., floods, hurricanes), the coastal community load profiles can be satisfied using local MHK resources in each microgrid with limited or no power support from upstream power grids.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

This paper aims at developing a data-driven optimal control strategy for virtual synchronous generator (VSG) in the scenario where no expert knowledge or requirement for system model is available. Firstly, the optimal and adaptive control problem for VSG is transformed into a reinforcement learning task. Specifically, the control variables, i.e., virtual inertia and damping factor, are defined as the actions. Meanwhile, the active power output, angular frequency and its derivative are considered as the observations. Moreover, the reward mechanism is designed based on three preset characteristic functions to quantify the control targets: (1) maintaining the deviation of angular frequency within special limits; (2) preserving well-damped oscillations for both the angular frequency and active power output; (3) obtaining slow frequency drop in the transient process. Next, to maximize the cumulative rewards, a decentralized deep policy gradient algorithm, which features model-free and faster convergence, is developed and employed to find the optimal control policy. With this effort, a data-driven adaptive VSG controller can be obtained. By using the proposed controller, the inverter-based distributed generator can adaptively adjust its control variables based on current observations to fulfill the expected targets in model-free fashion. Finally, simulation results validate the feasibility and effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Cyber-Resilient Automatic Generation Control for Systems of AC Microgrids

In this paper we propose a co-design of the secondary frequency regulation in systems of AC microgrids and its cyber security solutions. We term the secondary frequency regulator a Micro-Automatic Generation Control (μ AGC) for highlighting its same functionality as the AGC in bulk power systems. We identify sensory challenges and cyber threats facing the μ AGC. To address the sensory challenges, we introduce a new microgrid model by exploiting the rank-one deficiency property of microgrid dynamics. This model is used to pose an optimal μ AGC control problem that is easily implemented, because it does not require fast frequency measurements. An end-to-end cyber security solution to the False Data Injection (FDI) attack detection and mitigation is developed for the proposed μ AGC. The front-end barrier of applying off-the-shelf algorithms for cyber attack detection is removed by introducing a data-driven modeling approach. Finally, we propose an observer-based corrective control for an islanded microgrid and a collaborative mitigation scheme in systems of AC microgrids. We demonstrate a collaborative role of systems of microgrids during cyber attacks. Furthermore, the performance of the proposed cyber-resilient μ AGC is tested in a system of two networked microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Blade planform design optimization to enhance turbine wake control

Abstract This study considers optimizing the planform of wind turbine blades to ultimately enhance wind plant controls, namely, wake steering strategies. Adjoint‐enabled unsteady actuator line simulations are carried out to obtain gradients for optimization of several different performance objectives with respect to blade chord length at 10 locations along blade span. We demonstrate different blade design optimizations that can maximize time‐averaged lateral wake deflection, entrainment of kinetic energy, or total power of multiple turbines. Our optimized designs can produce a 4+% increase in wake deflection, a 4× increase in vertical kinetic energy entrainment, or a 3.6% increase in power when compared with the baseline case. While lateral wake deflection is only modestly sensitive to chord changes, we find that increasing the outboard chord length can dramatically increase kinetic energy entrainment, resulting in faster wake recovery and gains in net power. While this work develops only a few case studies emphasizing relative performance improvements and general trends, these results show the promise of a framework that combines mid‐fidelity computation with adjoint‐based optimization for control and design problems.

WIND ENERGY↗
DOE OSTI2025

Nonlinear Optimal Control of Electron Dynamics Within Hartree-Fock Theory

Consider the problem of determining the optimal applied electric field to drive a molecule from an initial state to a desired target state. For even moderately sized molecules, solving this problem directly using the exact equations of motion—the time-dependent Schrödinger equation (TDSE)—is numerically intractable. Here, we present a solution of this problem within time-dependent Hartree-Fock (TDHF) theory, a mean field approximation of the TDSE. Optimality is defined in terms of minimizing the total control effort while maximizing the overlap between desired and achieved target states. We frame this problem as an optimization problem constrained by the nonlinear TDHF equations; we solve it using trust region optimization with gradients computed via a custom-built adjoint state method. For three molecular systems, we show that with very small neural network parametrizations of the control, our method yields solutions that achieve desired targets within acceptable constraints and tolerances.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Third-integer Resonant Extraction Regulation System for Mu2e

A third-integer resonant slow extraction system is being developed for Fermilab's Delivery Ring to deliver protons to the upcoming Mu2e experiment. The timescale of the extraction (or spill) duration is 43 milliseconds, which is extremely short and unprecedented. Additionally, the experiment's strict and challenging requirements on the quality of the spill at this time scale has led to the development of a new Spill Regulation System (SRS) design. The SRS primarily consists of three components - slow regulation, fast regulation, and harmonic content suppressor. Contributions to the first two components of the SRS, i.e., Slow Regulation and Fast Regulation subsystems, will be presented in which new adaptive learning algorithm schemes for the slow regulation of the spill -- validated using particle tracking simulations -- shall be described. In addition to these novel methods for the enhancement of the spill regulation system, results of employing Machine Learning in enhancing the performance of the resonant extraction are also presented. At the forefront of applying ML techniques to solve non-linear accelerator control problems, this work includes optimizing the PID gains as well as the replacement of the traditional PID controller using Recurrent Neural Networks and Gated Recurrent Unit (GRU) ML models to achieve efficiencies greater than a PID controller. Cutting-edge on-going Reinforcement Learning efforts, including an actor-critic family of learning algorithms, to regulate the spill rate will be reviewed, as well as present analytical calculations pertaining the transit time of particles in a third-integer resonant extraction. Detailed numerical investigations and validations of such calculations, the model of which could be exported and reliably used in future analytical modeling of any resonant extraction, are discussed.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

Binary Control Pulse Optimization for Quantum Systems

Quantum control aims to manipulate quantum systems toward specific quantum states or desired operations. Designing highly accurate and effective control steps is vitally important to various quantum applications, including energy minimization and circuit compilation. In this paper we focus on discrete binary quantum control problems and apply different optimization algorithms and techniques to improve computational efficiency and solution quality. Specifically, we develop a generic model and extend it in several ways. We introduce a squared L 2 -penalty function to handle additional side constraints, to model requirements such as allowing at most one control to be active. We introduce a total variation (TV) regularizer to reduce the number of switches in the control. We modify the popular gradient ascent pulse engineering (GRAPE) algorithm, develop a new alternating direction method of multipliers (ADMM) algorithm to solve the continuous relaxation of the penalized model, and then apply rounding techniques to obtain binary control solutions. We propose a modified trust-region method to further improve the solutions. Our algorithms can obtain high-quality control results, as demonstrated by numerical studies on diverse quantum control examples.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Xopt and Badger: a machine learning ecosystem for real-time accelerator control and optimization

Machine learning (ML)-based black-box optimization algorithms have demonstrated significant improvements in accelerator optimization speed, often by orders of magnitude. However, deploying these algorithms in real-time facility control remains challenging due to the specialized expertise and infrastructure required. To bridge this gap, we introduce the Xopt ecosystem, a versatile suite of tools designed to make advanced ML-based optimization accessible to the broader accelerator community. This ecosystem includes Xopt, a modular Python framework that facilitates the integration of ML-based optimization algorithms with arbitrary control problems, and Badger, a graphical user interface built on top of Xopt, which enables seamless deployment of ML algorithms in real-time control systems. The Xopt ecosystem has been successfully applied towards solving challenging real-time control problems at leading international accelerator facilities, including SLAC, LBNL, Argonne, Fermilab, BNL, DESY, and ESRF, demonstrating its effectiveness in real-world optimization tasks. In this presentation, we provide an overview of Xopt’s capabilities and illustrate its impact through case studies from SLAC accelerator facilities including LCLS, LCLS-II, and FACET-II.

Roussel, Ryan [SLAC]↗
DOE OSTI2021

Convergence of sum-up rounding schemes for cloaking problems governed by the Helmholtz equation

In this work, we consider the problem of designing a cloak for waves described by the Helmholtz equation from an integer programming point of view. The problem can be modeled as a PDE-constrained optimization problem with integer-valued control inputs that are distributed in the computational domain. A first-discretize-then-optimize approach results in a large-scale mixed-integer nonlinear program that is in general intractable because of the large number of integer variables that arise from the discretization of the domain. Instead, we propose an efficient algorithm that is able to approximate the local infima of the underlying nonconvex infinite-dimensional problem arbitrarily close without the need to solve the discretized finite-dimensional integer programs to optimality. We optimize only the continuous relaxations of the approximations for local minima and then apply the sum-up rounding methodology to obtain integer-valued controls. If the solutions of the discretized continuous relaxations converge to a local minimizer of the continuous relaxation, then the resulting discrete-valued control sequence converges weakly \(^*\) in \(L^\infty\) to the same local minimizer. These approximation properties follow under suitable refinements of the involved discretization grids. Our results use familiar concepts arising from the analytical properties of the underlying PDE and complement previous results, derived from a topology optimization point of view.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

High-dimensional control co-design of a wave energy converter with a novel pitch resonator power takeoff system

Researchers are exploring adding wave energy converters to existing oceanographic buoys to provide a predictable source of renewable power. A ”pitch resonator” power take-off system has been developed that generates power using a geared flywheel system designed to match resonance with the pitching motion of the buoy. However, the novelty of the concept leaves researchers uncertain about various design aspects of the system. This work presents a novel design study of a pitch resonator to inform design decisions for an upcoming deployment of the system. The assessment uses control co-design via WecOptTool to optimize control trajectories for maximal electrical power production while varying five design parameters of the pitch resonator. Given the large search space of the problem, the control trajectories are optimized within a Monte Carlo analysis to identify optimal designs, followed by parameter sweeps around the optimum to identify trends between the design parameters. The gear ratio between the pitch resonator spring and flywheel are found to be the most sensitive design variables to power performance. Finally, the assessment also finds similar power generation for various sizes of resonator components, suggesting that correctly designing for optimal control trajectories at resonance is more critical to the design than component sizing.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Eco-driving Profile Optimization by Dynamic Programming for Battery Electric Vehicles

Although full automation has not yet been achieved, automated vehicles are a valid research area. Not only would automated vehicles provide ultimate driver convenience, but they would maximize energy efficiency by eliminating undesired human driving behaviors and optimally controlling the powertrain. From the perspective of control related to energy saving, speed profile optimization is important for improving system efficiency and satisfying passenger demands. This study employs Dynamic Programming (DP) to solve the constrained optimal problem for travel time, distance, and speed limit by exploring all possible control options. The solutions obtained by DP demonstrate consistent control patterns combining four control modes-acceleration, cruising, coasting, and braking, with cruising or coasting being selective depending on the boundary conditions. Further, this study introduces DP-based simulation results and attempts to provide comprehensive interpretations of the optimal policy by analyzing the essential factors that affect the control problem, including boundary conditions, road load, and powertrain characteristics. Based on these interpretations, the control concepts can be explained as the optimal policy selecting the best control option based on system efficiency and boundary conditions. The results of DP are compared with a human-like driver model to show that the optimal speed profiles can effectively reduce energy consumption.

Autonomous vehicles↗
DOE OSTI2024

Distribution Grid Incentive Design with Unknown Agent Behavior

Motivation: During extreme events, traditional grid regulation methods (e.g., energy prices, net power injection limits) may be insufficient. While system operators typically lack control over end-user grid interactions, (e.g., energy demand), incentives can influence behavior - for example, a user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. Problem: Optimize for the best incentive subject to system stability constraints. However, user behavior is unknown to the SO - i.e., for a given incentive, the amount of curtailed load or control variables exposed is unknown.

feedback based control↗
DOE OSTI2021

Synthetic Reference-based Transition Optimal Control of Inverter for Surge-Current-Free Rapid Interface to Grid

This article addresses the problem of the transition between objective functions in optimal control for power inverters when switching between standalone and grid-connected modes. The work proposes the use of a synthetic reference during the transition between the corresponding objective functions. Moreover, the authors aim to show that a transition function can be imposed and controlled externally from the main optimal control routine. In the end, the simulation results demonstrate the importance of properly applying the proposed strategy for a smooth transition between the operating modes with minimal surge current. These results contrast with the strategies found in the literature where the smooth transition comes with the price of a few grid cycles to sync.

Roig Greidanus, Mateo D.↗
DOE OSTI2020

Convex Relaxation of Grid-Connected Energy Storage System Models With Complementarity Constraints in DC OPF

Including complementarity constraints in energy storage system (ESS) models in optimization problems ensure an optimal solution will not produce a physically unrealizable control strategy where there is simultaneous charging and discharging. However, the current approaches to impose complementarity constraints require the use of non-convex optimization methods. Here, we propose a convex relaxation for a common ESS model that has terms for both charging and discharging based on a penalty reformulation for use in a model predictive control (MPC) based optimal power flow (DC OPF) problem. In this approach, the complementarity constraints are omitted and a penalty term is added to the optimization objective function. For the DC OPF problem, we provide analysis for the conditions under which the convex relaxation of the complementarity constraint ensures that a solution with simultaneous ESS charging and discharging operation is suboptimal. Simulation results demonstrating ESS behavior with and without the penalty reformulation are provided for an MPC-based DC OPF problem on multiple IEEE test systems.

25 ENERGY STORAGE↗