Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed online control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

A Hybrid-Learning Algorithm for Online Dynamic State Estimation in Multimachine Power Systems

With the increasing penetration of distributed generators in the smart grids, having knowledge of rapid real-time electromechanical dynamic states has become crucial to system stability control. Conventional Supervisory Control and Data Acquisition (SCADA)-based dynamic state estimation (DSE) techniques are limited by the slow sampling rates, while the emerging phasor measurement units (PMUs) technology enables rapid real-time measurements at network nodes. Using generator bus terminal voltages, we propose a hybrid-learning DSE (HL-DSE) algorithm to estimate the synchronous machine rotor angle and speed in real time. The HL-DSE takes the power system model into account and trains neuroestimators with real-time data in an online manner. Compared with traditional DSE methods, the HL-DSE overcomes limitations by using a data-driven approach in conjunction with the physical power system model. The time efficiency, accuracy, convergence, and robustness of the proposed algorithm are tested under noises and fault conditions in both small- and large-scale test systems. Simulation results show that the proposed HL-DSE is much more computationally efficient than widely used Kalman filter (KF)-based methods while maintaining comparable accuracy and robustness. In particular, HL-DSE is over 100 times faster than square-root unscented KF (SR-UKF) and 80 times faster than extended KF (EKF). The advantages and challenges of the HL-DSE are also discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Design, Deployment, and Characterization of the World’s First Flexible Large Power Transformer

GE Research and its partner Prolec GE have designed, built and deployed in the field the world’s first flexible power transformer. The flexible power transformer is a transmission class 3-phase autotransformer configurable in impedance and in voltage which allows it to serve as a universal spare for multiple units in a given fleet. However, the key innovation in this new concept is the online adjustable leakage impedance which allows the transformer to change its impedance without interrupting the transmission line operation. The flexible power transformer can be designed with up to three low voltage transmission class ratings and up to 12 impedance values changeable both online and offline. This report provides an overview of the design, manufacturing, testing, and commissioning of the 165kV, 60MVA prototype built including the results of the field performance validation tests. The prototype was specified in collaboration with Cooperative Energy, the utility host. It was designed and tested in the factory according to IEEE standard C57.12.00 and followed all protocols for transportation, installation, and commissioning of a power transformer. In addition to the prototype, a flexible protection system capable of automatically adjusting its settings upon the transformer impedance was also developed and deployed in the for testing and validation. On September 3, 2021 the prototype was energized in Cooperative Energy’s substation in Columbia, Mississippi to become the world’s first flexible power transformer in operation. Its performances and impact on the grid operation were demonstrated through different field tests. Results obtained confirm that the impedance of the flexible transformer can be varied under load through its full range, from 4.3% to 9.3%, without adverse impacts on the line operation, the protection system, the transformer stability and health condition. Results also proved that the flexible transformer is very effective in controlling power transfer through the line or load sharing between units operating in parallel. Indeed, it was proven that higher impedances decrease the thruput power of the transformer while lower impedances increase it. Up to 26MW was controllable on a line loading of 45MVA. It was also possible to demonstrate that the variation of the transformer impedance has no effect on the circulating current between units in parallel, except a minor transient during the impedance change. It was also proven that the flexible protection relay can update its protection settings automatically when the impedance change was detected. The prototype has operated continuously for more than 12 months now with a peak load exceeding 50MVA corresponding to >80% of its ONAN power rating. No alarm, trip or sign of failure has been reported by the utility. In addition to the development and deployment of the flexible transformer prototype, investigations were carried out on new nanodielectric fluids to replace the mineral oil used in power transformers with the goal of reducing their footprint and weight. The key parameters that were targeted for improvement included the breakdown voltage to reduce clearances between windings and tank hence the footprint; viscosity and thermal conductivity to increase the cooling efficiency and therefore to reduce the winding material. Several nanodielectric mixtures with mineral oil including with alumina (Al2O3), titania (TiO2) and Borum Nitrate (BN) with different surfactants have been analyzed and tested. Unfortunately, despite encouraging results no nanofluid candidate has been found viable to replace mineral oil. With the formulations tested, breakdown voltages are generally similar to mineral oil at lower particle contents and worse at higher particle contents. Viscosity appreciably increased at particles concertation over 2 wt% and thermal conductivity increased slightly at 5wt% and appears to be 10-15% higher at 10 wt% particle content. It is recommended to continue investigations to find solutions that can help increase the power density of future flexible power transformers. Flexible power transformers can significantly help the future power grid by providing more flexibility and resiliency. Indeed, by providing voltage and impedance flexibility, flexible power transformers reduce the need for multiple spares, hence inventory costs for utilities. With their online controllable impedance, they can provide support to the grid and help manage short-circuit currents, power flow, line congestion, and grid stability which will become more important with higher penetrations of intermittent renewable resources. During the field validation tests, it was demonstrated that up to 26MW was controllable on a line loading of 45MVA when the transformer impedance was varied from its minimum to its maximum range. Also, with the impedance range, the short-circuit currents could be reduced by up to 38% at the load side of the transformer. With its controllable impedance, flexible transformers can be used in future strategies of grid resilience to help better prepare the grid to face forecasted severe events including storms, heat waves and contingencies. The flexible power transformers can also find role in other applications including high voltage transmission cables such as offshore wind farms where solutions for energizing the cables and managing the reactive power are of critical importance. The designed flexible power transformer is now fully validated and ready for commercialization. Further analysis on the benefits of flexible power transformers for grid stability and short-circuit management including current limiting capability, reclosure and line restoration, control of inrush current, sizing of flexible AC components (FACTS) would help its rapid adoption by the industry.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

A Learning-based Supervisory Control Architecture for Electric Vehicle Charging System Paired with Energy Storages

A Machine Learning-based predictive model is developed for optimal dispatching energy storage system integrated with Electric Vehicle battery charger. The model is effectively trained using transfer learning algorithm and successfully validated via measurement data to achieve high fidelity and accuracy. The study findings provide possibilities for future development of the presented approach to implement computational heavy predictive algorithms with multi-step predictions in emerging modular bidirectional charger topologies to realize vehicle-to-grid (V2G) technology. The online tuning can be explored using the new measurements obtained during the operation, henceforth, enhancing the controller performance for integrating multiple DERs into distribution power networks that shows huge interest for the utilities and regulatory agencies. Multiple operation scenatios have been evaluated and simulation results are discussed to verify intended performance of the proposed control solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A neural-network-enhanced parameter-varying framework for multi-objective model predictive control applied to buildings

Management of the electrical grid is becoming more complex due to the increased penetration of alternative energy generation technologies and a broadening diversity of electric loads. This complexity creates challenges in balancing demand and generation that can increase the potential for grid instabilities. One effective way to address this issue is to leverage previously unexploited demand flexibility through advanced control strategies. In this work, we propose an advanced control method, called adaptive neural parameter-varying model predictive control (ANPV-MPC), to control the temperature and energy consumption of a building via its Heating, Ventilation, and Air Conditioning system. ANPV-MPC combines key ideas in parameter-varying control, adaptive control, and online learning strategies to bridge the gap between computationally efficient linear model predictive control and more accurate nonlinear model predictive control. The novelty in ANPV-MPC is the use of a physics-inspired Bayesian neural network to estimate the coefficients of the parameter-varying linear control model. The Bayesian neural network additionally provides uncertainty estimates, triggering online training to capture evolving building system conditions. We show that ANPV-MPC can approximate the building system dynamics with a 28.39% higher accuracy than traditional linear model predictive control, resulting in 36.23% better control performance without increasing complexity of the optimal control problem. ANPV-MPC also adapts in real time to previously unseen conditions using online learning, further improving its performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

A Hybrid Optimization and Deep Learning Algorithm for Cyber-Resilient DER Control

With the proliferation of distributed energy resources (DERs) in the distribution grid, it is a challenge to effectively control a large number of DERs resilient to the communication and security disruptions, as well as to provide the online grid services, such as voltage regulation and virtual power plant (VPP) dispatch. To this end, a hybrid feedback-based optimization algorithm along with deep learning forecasting technique is proposed to specifically address the cyber-related issues. The online decentralized feedback-based DER optimization control requires timely, accurate voltage measurement from the grid. However, in practice such information may not be received by the control center or even be corrupted. Therefore, the long short-term memory (LSTM) deep learning algorithm is employed to forecast delayed/missed/attacked messages with high accuracy. The IEEE 37-node feeder with high penetration of PV systems is used to validate the efficiency of the proposed hybrid algorithm. The results show that 1) the LSTM-forecasted lost voltage can effectively improve the performance of the DER control algorithm in the practical cyber-physical architecture; and 2) the LSTM forecasting strategy outperforms other strategies of using previous message and skipping dual parameter update.

cyber-resilient algorithm↗
DOE OSTI2020

Online Optimization for Networked Distributed Energy Resources With Time-Coupling Constraints

This paper proposes a Lyapunov optimization-based online distributed (LOOD) algorithmic framework for active distribution networks (ADNs) with numerous photovoltaic inverters and inverter air conditionings (IACs). In the proposed scheme, ADNs can track an active power setpoint reference at the substation in response to transmission-level requests while concurrently minimizing the social utility loss and ensuring the security of voltages. Conventional distributed optimization methods are rarely feasible to track the optimal solutions in fast variable environments using a fine-grained sampling interval where the underlying optimization problem evolves with the iterations of the algorithms. In contrast, based on the framework of online convex optimization (OCO), the developed approach uses a distributed algebraic update to compute the next round decisions relying on the current feedback of measurements. Notably, the time-coupling constraints of IACs are decoupled for online implementation with Lyapunov optimization technique. An incentive scheme is tailored to coordinate the customer-owned assets in lieu of the direct control from network operators. Optimality and convergency are characterized analytically. Finally, we corroborate the proposed method on a modified version of 33-node test feeder. Benchmark tests show that the proposed method is computationally and economically efficient, and outperforming existing algorithms.

active distribution networks↗
DOE OSTI2023

Primal-Dual Differentiable Programming for Distribution System Critical Load Restoration: Preprint

Swift and reliable critical load restoration (CLR) can help make a distribution system resilient towards extreme events. To optimally achieve that, alongside practical concerns such as limiting online computational burden, some studies leverage model-free reinforcement learning (RL) to train control policies. Despite the advantages provided by RL algorithms, these approaches suffer from two issues: 1) the lack of a proper mechanism for constraint enforcement, and 2) poor sample efficiency. Therefore, in this paper, a primal-dual differentiable programming (PDDP) method is developed for guiding the training leading to a constraint-satisfying policy. Additionally, the model-based nature of the proposed method aims at improving sample efficiency. The experiment on a CLR problem demonstrates that PDDP can effectively train a control policy that both achieves desirable performance and satisfies required constraints.

differentiable programming↗
DOE OSTI2020

Model-Free Dynamic Voltage Control of a Synchronous Generator-Based Microgrid

The main goal of this paper is to present a new dynamic voltage stability mechanism, based on model-free control (MFC), for effective control and coordination of synchronous generator (SG)-based reactive power resources in a microgrid setting. MFC has shown successful operation in various domains, and this paper presents its first use in the voltage stability of a power system. It is utilized as an online controller to achieve the dynamic voltage stability of a microgrid system under different disturbances and fault conditions. A 21-bus microgrid system fed by SG-based distributed energy resources (DERs) is considered as a use case study. The overall dynamic voltage stability of the microgrid system is investigated using time-domain dynamic simulations during emergency, hazard, and disaster events. Simulation results show that there are significant improvements and enhancements on the dynamic load bus voltage profiles of the microgrid system by the effective model-free control and coordination of the reactive power reserves of the SG-based DERs.

Hatipoglu, Kenan↗
DOE OSTI2022

DERMS Online: A New Voltage Sensitivity-Enabled Feedback Optimization Framework: Preprint

This paper proposes a distributed energy resource management system (DERMS) solution by developing a new voltage sensitivity enabled feedback optimization framework. The key idea is to adopt a measurement feedback scheme to reformulate the original nonlinear optimization into a linear programming (LP) problem via perturb and observe-based voltage sensitivity analysis. The proposed solution eliminates the dependence on load knowledge and can be implemented online thanks to an efficient open-source solver for LP problems. The proposed DERMS online platform is generalizable to deal with various types of distributed energy resources (DERs), including distributed photovoltaics (PVs), energy storage, electric vehicles, demand response, etc. Comparison results with other control methods on a realistic distribution feeder in Southern California highlight the feasibility as well as benefits for the proposed framework.

distributed energy resources management↗
DOE OSTI2022

Advanced Distributed Wind Turbine Controls Series: Part 4-Wind Energy in Microgrids – Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL)

In recent years, the technical capabilities and requirements for distributed wind turbines to provide ancillary services beyond maximum energy production has increased. Ancillary services, leveraged through advanced wind turbine controls, can support grid stability, reliability, and resilience. In the context of a microgrid, wind turbines can provide ancillary services that are useful in both islanded and grid-connected modes, as demonstrated in previous parts of this report series. This report focuses on how wind turbines with advanced controls and power electronics can support the stability of the microgrid during transitions from grid-connected to island mode, and back. This report documents simulation results from a model of the National Renewable Energy Laboratory (NREL) Flatirons Campus containing NREL's 600-kilowatt Controls Advanced Research Turbine. Using this turbine, we demonstrate through desktop simulation how a wind turbine can support the voltage and frequency of a microgrid during transitions - from making planned transitions seamless to keeping all loads online during some unplanned transitions to supporting black start in the event of an open transition (blackout).

17 WIND ENERGY↗
DOE OSTI2023

Deep-Learning-Based Koopman Modeling for Online Control Synthesis of Nonlinear Power System Transient Dynamics

Power system stability and control have become more challenging due to the increasing uncertainty associated with renewable generation. Here, the performance of conventional control is highly driven by the physics-based offline-developed dynamic models that can deviate from the actual system characteristics under different operating conditions and/or configurations. Data-driven approaches based on online measurements can be a better solution to addressing these issues by capturing real-time operation conditions. This article describes a novel fully data-driven probabilistic framework to derive a linear representation of postcontingency grid dynamics and online prescribe control based on the derived model to enhance transient stability. The complex nonlinear power system dynamics is approximated by a linear model by using multiple neural network modules that infer distributions of the observations and introducing a Koopman layer to sample possible Koopman linear models from the inferred distributions. The trained model features linearity that can be easily incorporated into the existing linear control design paradigm and ease the controller design process. The effectiveness of Koopman-based control designs is validated through comparative case studies, which demonstrate increased prediction accuracy and control performance when applied to a power system with heterogeneous generator dynamics.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Distribution Feeder-Scale Fast Frequency Response via Optimal Coordination of Net-load Resources Part I: Solution Design

This work is the first of a two-part series that develops and experimentally demonstrates a first-of-its-kind hierarchical control solution for optimally dispatching thousands of deferrable loads and distributed energy resources (DERs) across a distribution feeder to provide fast frequency response (FFR) within 500 ms to the bulk power system. This approach rapidly coordinates resources online after a frequency event occurs, allowing fast-changing, behind-the-meter (BTM) resources to be incorporated and aggregate FFR power set points to be achieved more quickly and accurately than existing approaches. We also present a solution for determining the optimal amount of headroom to operate solar inverters with to minimize opportunity cost while ensuring the FFR response viability of a building with the inverter and deferrable loads. In Part I, we develop practical algorithms for fast, cost-based optimal dispatch at multiple aggregation scales (single building, multiple buildings, and full distribution feeder), establish their optimality, and demonstrate via simulation that they are faster than state-of-the-art, coordinated frequency response approaches. In Part II, the entire platform is implemented and experimentally verified using a unique power hardware-in-the-loop demonstration, including more than 100 powered loads and DERs connected to a real-world distribution network model and over 10,000 net-load resources dispatched.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

adaptation models↗
DOE OSTI2024

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation: Preprint

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

distribution system operator↗
DOE OSTI2024

Online Model-Free DER Dispatch Via Adaptive Voltage Sensitivity Estimation and Chance Constrained Programming

This paper proposes an online data-driven distributed energy resource management system (DERMS) for distribution system optimal DER dispatch as well as voltage regulation. Here, the key innovation is to leverage the Local Sensitivity Factor (LSF) for transforming the DER control into a computationally efficient linear programming (LP) problem. By taking real-time measurements, the estimation of LSF eliminates the need for an accurate distribution system model as well as full nodal load information, which is difficult to achieve in practice. A robust recursive least squares method is also developed to ensure the robust estimation of LSF, which is initialized using reasonable values from model-derived LSFs. This allows the system to adapt to changing operational conditions effectively. A scenario-based, chance-constrained framework is further employed to ensure voltage remains within acceptable limits in the presence of measurement and estimation uncertainties. Test results on a real-world, 759-node distribution network located in western Colorado, U.S., validate the effectiveness and robustness of the proposed control approach and demonstrate its superior performance as compared to alternative methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗