Hybrid Deep Reinforcement Learning For Online Distribution Power System Optimization and Control.
Abstract not provided.
Bailey, Tyson↗
SEARCH · Search NASA
Results for “Optimal Control”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Development and applications of Krotov method of global control improvement
This is a survey of works on main properties, application and development of the Krotov method of global control improvement very popular among researchers of modern problems in quantum physics and quantum chemistry, applying actively optimal control methods. The survey includes a brief description of the method in comparison with well known gradient method demonstrating such its serious advantage as absence of tuning parameters; investigations aimed to make its special version for the quantum system well defined and more effective; and generalization for wide classes of control systems, including the systems of heterogeneous structure.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Learning protocols for the fast and efficient control of active matter
Exact analytic calculation shows that optimal control protocols for passive molecular systems often involve rapid variations and discontinuities. However, similar analytic baselines are not generally available for active-matter systems, because it is more difficult to treat active systems exactly. Here we use machine learning to derive efficient control protocols for active-matter systems, and find that they are characterized by sharp features similar to those seen in passive systems. We show that it is possible to learn protocols that effect fast and efficient state-to-state transformations in simulation models of active particles by encoding the protocol in the form of a neural network. We use evolutionary methods to identify protocols that take active particles from one steady state to another, as quickly as possible or with as little energy expended as possible. Our results show that protocols identified by a flexible neural-network ansatz, which allows the optimization of multiple control parameters and the emergence of sharp features, are more efficient than protocols derived recently by constrained analytical methods. Our learning scheme is straightforward to use in experiment, suggesting a way of designing protocols for the efficient manipulation of active matter in the laboratory.
74 ATOMIC AND MOLECULAR PHYSICS↗
Optimal mitigation and control over power system dynamics for stochastic grid resilience
Optimal mitigation planning for highly disruptive contingencies to a transmission-level power system requires optimization with dynamic power system constraints, due to the key role of dynamics in system stability to major perturbations. We formulate a generalized disjunctive program to determine optimal grid component hardening choices for protecting against major failures, with differential algebraic constraints representing system dynamics (specifically, differential equations representing generator and load behavior and algebraic equations representing instantaneous power balance over the transmission system). We optionally allow stochastic optimal pre-positioning across all considered failure scenarios, and optimal emergency control within each scenario. This novel formulation allows, for the first time, analyzing the resilience interdependencies of mitigation planning, preventive control, and emergency control. Using all three strategies in concert is particularly effective at maintaining robust power system operation under severe contingencies, as we demonstrate on the western system coordinating council 9-bus test system using synthetic multi-device outage scenarios.
30 DIRECT ENERGY CONVERSION↗
Prevalence and scalable control of localized networks
The ability to control network dynamics is essential for ensuring desirable functionality of many technological, biological, and social systems. Such systems often consist of a large number of network elements, and controlling large-scale networks remains challenging because the computation and communication requirements increase prohibitively fast with network size. Here, we introduce a notion of network locality that can be exploited to make the control of networks scalable, even when the dynamics are nonlinear. We show that network locality is captured by an information metric and is almost universally observed across real and model networks. In localized networks, the optimal control actions and system responses are both shown to be necessarily concentrated in small neighborhoods induced by the information metric. This allows us to develop localized algorithms for determining network controllability and optimizing the placement of driver nodes. This also allows us to develop a localized algorithm for designing local feedback controllers that approach the performance of the corresponding best global controllers, while incurring a computational cost orders-of-magnitude lower. Here, we validate the locality, performance, and efficiency of the algorithms in Kuramoto oscillator networks, as well as three large empirical networks: synchronization dynamics in the Eastern US power grid, epidemic spreading mediated by the global air-transportation network, and Alzheimer’s disease dynamics in a human brain network. Taken together, our results establish that large networks can be controlled with computation and communication costs comparable to those for small networks.
42 ENGINEERING↗
Optimal PV Inverter Control in Distribution Systems via Data-Driven Distributionally Robust Optimization
Distribution systems with high penetration of uncertain solar generation call for advanced control strategies of photovoltaics (PVs) inverters. This paper proposes a data-driven distributionally robust optimization (DDDRO) approach to optimally controlling the PV inverters to improve the system operation performance under solar power uncertainties. In the proposed DDDRO approach, a Wasserstein ball-based method is proposed to construct the distributional ambiguity set to model the uncertainties of PV generation through partial observations of historical data without knowing exact probability distributions. We further reformulate the computationally intractable DDDRO model to a mixed integer second order cone programming (MISOCP) problem. The effectiveness and out-of-sample performance of the proposed approach have been demonstrated on a modified IEEE 33-node system. We conduct a comparative study to compare the proposed method with traditional chance constrained programming (CCP). It shows that the proposed DDDRO approach can provide a less conservative yet robust solution to minimize the worse-case expectation of the total network loss while maintaining nodal voltages in a secure range.
Xue, Yaosuo↗
H ∞ Control for Energy Dispatch in Autonomous Nanogrid With Communication Delays
This paper proposes an optimal controller and estimator for energy dispatch to balance the power supply and demand considering communication delays. The proposed algorithm involves modeling an autonomous nanogrid (ANG) consisting of distributed energy resources, energy storage systems, loads, an $H$ ∞ controller with a reference power modulation technique, and a state estimator. The ANG was developed to express the dynamic supply-demand energy balance of a nanogird system. Reference power modulation was designed to generate the desired ESS power based on the imbalanced energy. Random communication delays were modeled using a stochastic variable satisfying the Bernoulli random binary distribution. The optimal $H$ ∞ controller and estimator were developed using a linear matrix inequality approach to exponentially stabilize the closed-loop system. Simulations were performed using real daily demand forecasts obtained from the Korea Meteorological Administration to demonstrate the effectiveness of the proposed real-time optimization algorithm.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Risk-Averse Control of Fractional Diffusion with Uncertain Exponent
In this paper, we introduce and analyze a new class of optimal control problems constrained by elliptic equations with uncertain fractional exponents. We utilize risk measures to formulate the resulting optimization problem. We develop a functional analytic framework, study the existence of solution and rigorously derive the first-order optimality conditions. Additionally, we employ a sample-based approximation for the uncertain exponent and the finite element method to discretize in space. Further, we prove the rate of convergence for the optimal risk neutral controls when using quadrature approximation for the uncertain exponent and conclude with illustrative examples.
finite element method↗
Optimizing Traffic Signal Control to Enhance Transportation Efficiency and Maximize Pedestrian Benefits in the Road Network
Increasing urban mobility requirements demand efficient transportation system strategies for both vehicular and pedestrian movement. This study enhances the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) approach, originally tailored for vehicular traffic signal timing, to incorporate pedestrian traffic dynamics. The improved algorithm considers crucial metrics such as Eco_PI, assesses vehicle fuel consumption by factoring in stops and delays, and addresses pedestrian waiting time, crucial for system efficiency while acknowledging driver waiting time impact. Utilizing Digital Twin simulation along the MLK Smart Corridor in Chattanooga, Tennessee, the algorithm's performance is compared for various pedestrian control scenarios. To evaluate the effectiveness of DGMARL, this study compared DGMARL-enabled signal management with automated pedestrian traffic detection and an actuated signal management system (real-word baseline) with pedestrian recall, which predetermingly enforces a pedestrian phase every cycle. Findings indicate substantial improvements with DGMARL, showing a 28.29% enhancement in vehicle Eco_PI, a 60.55 % reduction in pedestrian waiting time, and a 55.74% decrease in driver stop delay, on average, compared to the baseline actuated signal timing plan.
Kumarasamy, Vijayalakshmi K [The University of Ten↗
Eco-driving Profile Optimization by Dynamic Programming for Battery Electric Vehicles
Although full automation has not yet been achieved, automated vehicles are a valid research area. Not only would automated vehicles provide ultimate driver convenience, but they would maximize energy efficiency by eliminating undesired human driving behaviors and optimally controlling the powertrain. From the perspective of control related to energy saving, speed profile optimization is important for improving system efficiency and satisfying passenger demands. This study employs Dynamic Programming (DP) to solve the constrained optimal problem for travel time, distance, and speed limit by exploring all possible control options. The solutions obtained by DP demonstrate consistent control patterns combining four control modes-acceleration, cruising, coasting, and braking, with cruising or coasting being selective depending on the boundary conditions. Further, this study introduces DP-based simulation results and attempts to provide comprehensive interpretations of the optimal policy by analyzing the essential factors that affect the control problem, including boundary conditions, road load, and powertrain characteristics. Based on these interpretations, the control concepts can be explained as the optimal policy selecting the best control option based on system efficiency and boundary conditions. The results of DP are compared with a human-like driver model to show that the optimal speed profiles can effectively reduce energy consumption.
Autonomous vehicles↗
Predictive drug dosage control through a Fokker–Planck observer
During the years, various techniques have been presented for optimal control of tumor growth for which its stochastic behavior has rarely been considered. This article uses the well-known Gompertz stochastic model, for describing tumor growth, and by receding horizon model predictive control (RH-MPC) scheme computes the drug dosage for minimizing the tumor-cell population. To do this, a predictive control problem is defined based on the difference between the probability density function of tumor-cell population and the desired probability density function. In the model, both the drug dosage limitation and the Fokker–Planck equation have been considered as constraints. By solving this problem, the drug dosage which is considered as an external input to tumor model, is computed. In this article, the Fokker–Planck equation is used (1) as a nonlinear observer of probability density function of tumor-cell population and (2) a mapping vehicle from stochastic to deterministic domain. The Fokker–Planck equation is written for the Gompertz stochastic model of tumor growth. The equation is then solved through the path integral method. In this way, the probability density function of tumor-cell population, which contains the entire stochastic characteristics of the tumor growth, is obtained for any instance of time. The simulation results have also been presented for the evaluation of the suggested approach. The results show that the tumor-cell population can be controlled within a number of time windows (15 time windows in our case study) if an appropriate desired PDF is selected.
97 MATHEMATICS AND COMPUTING↗
A Minimum Principle-Based Algorithm for Energy-Efficient Eco-Driving of Electric Vehicles in Various Traffic and Road Conditions
Our report presents an optimization algorithm for energy-efficient driving of electric vehicles. The algorithm is based on Pontryagin’s Minimum Principle by considering the driving mission as an optimal control problem. On a planned route, diverse application cases may occur due to various physical traits such as powertrain (e.g., switching between motor and generator operation), environmental variations (e.g., terrain grade change), traffic laws (e.g., speed limits), and safety concerns (e.g., headway to the leading vehicle). The proposed algorithm handles these real-world challenges by considering the perturbation to the system dynamics and the constraints to the control and state variables.
33 ADVANCED PROPULSION SYSTEMS↗
Convergence Analysis for an Online Data-Driven Feedback Control Algorithm
This paper presents convergence analysis of a novel data-driven feedback control algorithm designed for generating online controls based on partial noisy observational data. The algorithm comprises a particle filter-enabled state estimation component, estimating the controlled system’s state via indirect observations, alongside an efficient stochastic maximum principle-type optimal control solver. By integrating weak convergence techniques for the particle filter with convergence analysis for the stochastic maximum principle control solver, we derive a weak convergence result for the optimization procedure in search of optimal data-driven feedback control. Numerical experiments are performed to validate the theoretical findings.
97 MATHEMATICS AND COMPUTING↗
Coordinated Scheduling for Interdependent Electric Power and Natural Gas Infrastructures
The extensive installation of gas-fired power plants in many parts of the world has led electric systems to depend heavily on reliable gas supplies. The use of gas-fired generators for peak load and reserve provision causes high intraday variability in withdrawals from high-pressure gas transmission systems. Such variability can lead to gas price fluctuations and supply disruptions that affect electric generator dispatch, electricity prices, and threaten the security of power systems and gas pipelines. These infrastructures function on vastly different spatio-temporal scales, which prevents current practices for separate operations and market clearing from being coordinated. Here in this article, we apply new techniques for control of dynamic gas flows on pipeline networks to examine day-ahead scheduling of electric generator dispatch and gas compressor operation for different levels of integration, spanning from separate forecasting, and simulation to combined optimal control. We formulate multiple coordination scenarios and develop tractable physically accurate computational implementations. These scenarios are compared using an integrated model of test networks for power and gas systems with 24 nodes and 24 pipes, respectively, which are coupled through gas-fired generators. The analysis quantifies the economic efficiency and security benefits of gas-electric coordination and dynamic gas system operation.
03 NATURAL GAS↗
GOAT. jl
SF-23-008 This project is a Julia implementation of the Gradient Optimization of Analytic conTrols (GOAT) optimal control methodology. It integrates with other packages in Julia's ecosystem to provide memory-efficient, parallelized solutions to quantum optimal control tasks. A prototype implementation of some of these algorithms was initially developed and funded by the ASCR Early Career Research Award program under PI Travis Humble at Oak Ridge National Laboratory. The current version was funded under the ASCR AIDE-QC Program under PI Paul Hovland. The current package to be released has a novel implementation, syntax, and structure making it substantially different than the original prototype (which was not released under copyright to the best of my knowledge).
KAIRYS, PAUL↗
Quandary
Quandary numerically simulates and optimizes the time-evolution of open quantum systems. The underlying dynamics are modelled by Lindblad's master equation, a linear ordinary differential equation (ODE) describing quantum systems interacting with the environment. Quandary solves this ODE numerically by applying a time-stepping integration scheme, and utilizes a gradient-based optimization approach to determine optimal control pulses that drive the quantum system to a desired target state. Two optimization objectives are considered: (a) Unitary gate optimization that finds controls to realize a unitary gate transformation, and (b) optimal reset that aims to drive the quantum system to the ground states. Gradient-based optimization schemes utilizing Petsc's Tao optimization package are applied to generate control pulses that minimize the respective measure. To evaluate the gradient of the objective function, the discrete adjoint method is used while leveraging techniques from Algorithmic Differentiation to produce exact and consistent gradients. To mitigate excessive execution run times, the software can be build together with the XBraid software library which provides a parallelization strategy to distribute the time-evolution of the underlying dynamics onto multiple processor.
Petersson, NilsA.↗
Optimal current profile control for enhanced repeatability of L-mode and H-mode discharges in DIII-D
In this work, model-based control techniques are used to obtain target current profiles in low-confinement-mode (L-mode) as well as high-confinement-mode (H-mode) DIII-D discharges. The control problem is formulated as a trajectory optimization problem to search for a feasible path from the expected initial condition to the desired target. The result comprises a sequence of feedforward (open-loop) control requests and a corresponding state evolution from the initial condition to the desired target. On top of this optimal feedforward control sequence a feedback (closed-loop) controller based on a linearized model and optimal control design techniques is added to track the desired state evolution. Furthermore, the effectiveness of the control approach is demonstrated with experiments.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
EMOS (Energy Management Optimization System) [SWR-21-46]
EMOS software performs a real-time hierarchal optimal control for energy systems like multi-port electric vehicles charging site with distributed energy resources (DERs) and energy storage systems (ESSs). It gathers information in real-time from electric vehicles, power grid, and DERs, solves a multi-objective energy management optimization problem, and output setpoint for chargers, ESS converters, DERs converters, and grid converters. The software incorporates a novel integration of two control tasks: a) An Energy Management Optimization (EMO), which is the brain of EMOS controller that gathers information in real-time from EVs [e.g., battery size, state-of-charge (SOC), desired SOC, and charge acceptance curve], grid (e.g., electricity price, allowed feeder capacity, ramp rate limit, and reactive power), and DERs (e.g., prediction for solar generation for PV systems). It solves a control optimization problem in real-time to find optimal setpoint for ESSs power dispatch, EVs charging rate, and grid inverters. The objectives are to (1) minimize the charging cost considering grid energy, demand charges, and battery energy, (2) minimize charging time to meet fast charging criterion, (3) keep high energy level on ESSs at the end of an operating period, while satisfying constraints related to grid, EVs, and power converters. b) Real-Time Energy Management System (RT-EMS) is a rule-based algorithm that has faster response than EMO. It receives optimal setpoint from EMO and actual measurements from the system and modify the setpoint to compensate for any fast disturbance in the system, until a new optimum solution is received. Fast disturbances may include vehicle connect/disconnect, unpredicted variation in DERs profiles, variation in grid voltage, errors in PV generation prediction, and others. In addition, RT-EMS regulates voltage at point of common coupling (PCC) by managing reactive power of grid converters.
Mohamed, Ahmed↗