Eseye, Abinet Tesfaye (ORCID:0000000172251819)

DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

DOE OSTI2022

Scalable Predictive Control and Optimization for Grid Integration of Large-Scale Distributed Energy Resources: Preprint

Integration of a large number of distributed energy resources (DERs) into the power grid needs a scalable power balancing method. We formulate the power balancing problem as a look-ahead optimization problem to be solved sequentially by a power distribution system aggregator based on a model predictive control (MPC) framework. Solving large-scale look-ahead control problem requires proper configuration of the control steps. In this paper, to solve large-scale control problems, we propose a variable time granularity where control time steps nearby the current control step have finer resolutions. The aggregator objective includes maximization of power production revenue and minimization of power purchasing expense, renewable power curtailment, and mileage costs for energy storage and electric vehicle (EV) charging stations while satisfying system capacity and operational constraints. The control problem is formulated as a mixed-integer linear program (MILP) and solved using the XpressMP solver. We perform simulations considering a copper plate representation of a large distribution network consisting of 2507 devices (controllable DERs) including curtailable photovoltaics (PVs), energy storage batteries, EV charging stations, and buildings with heating, ventilation, and air conditioning units (HVACs). We show the effectiveness of the proposed approach in managing DERs interactively for maximum energy trading profit and local supply-demand power balancing. Finally, we demonstrate that the proposed method outperformed other benchmark controllers regarding computation time without compromising operational performance.

DER↗

DOE OSTI2021

Resilient Operation of Power Distribution Systems Using MPC-Based Critical Service Restoration

Power distribution systems are more prone to disruptions and cause most power system outages. We propose a service restoration technique to recover the system service (electricity delivery) following an extreme event-triggered substation outage. The proposed technique considers the problem of controlling distributed energy resources (DERs) of a distribution system with the objective of achieving maximum load pick up while satisfying network flow and voltage constraints. The problem is formulated as a model predictive control (MPC), where a linearized optimal power flow (OPF) model is employed to describe the network. The formulation is augmented with a ramping (up) reserve product for the DERs to ensure an upward monotonic load restoration as time evolves. We perform simulations considering the IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage devices. We demonstrate the efficacy of the devised technique in restoring the system loads monotonically, without shedding previously restored loads. We also show the benefit of co-optimization of power and reserve products for DERs on service restoration. In addition, the capability of the technique in regulating nodal voltages and reducing renewable power curtailment is demonstrated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoitaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoltaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Resilient Operation of Power Distribution Systems Using MPC-Based Critical Service Restoration

Power distribution systems are more prone to disruptions and cause most power system outages. We propose a service restoration technique to recover the system service (electricity delivery) following an extreme event-triggered substation outage. The proposed technique considers the problem of controlling distributed energy resources (DERs) of a distribution system with the objective of achieving maximum load pick up while satisfying network flow and voltage constraints. The problem is formulated as a model predictive control (MPC), where a linearized optimal power flow (OPF) model is employed to describe the network. The formulation is augmented with a ramping (up) reserve product for the DERs to ensure an upward monotonic load restoration as time evolves. We perform simulations considering the IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage devices. We demonstrate the efficacy of the devised technique in restoring the system loads monotonically, without shedding previously restored loads. We also show the benefit of co-optimization of power and reserve products for DERs on service restoration. In addition, the capability of the technique in regulating nodal voltages and reducing renewable power curtailment is demonstrated.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Resilient Operation of Power Distribution Systems Using MPC-Based Critical Service Restoration: Preprint

Power distribution systems are more prone to disruptions and cause most power system outages. We propose a service restoration technique to recover the system service (electricity delivery) following an extreme event-triggered substation outage. The proposed technique considers the problem of controlling distributed energy resources (DERs) of a distribution system with the objective of achieving maximum load pick up while satisfying network flow and voltage constraints. The problem is formulated as a model predictive control (MPC), where a linearized optimal power flow (OPF) model is employed to describe the network. The formulation is augmented with a ramping (up) reserve product for the DERs to ensure an upward monotonic load restoration as time evolves. We perform simulations considering the IEEE 13-bus test feeder integrated with wind, solar, microturbine, and energy storage devices. We demonstrate the efficacy of the devised technique in restoring the system loads monotonically, without shedding previously restored loads. We also show the benefit of co-optimization of power and reserve products for DERs on service restoration. In addition, the capability of the technique in regulating nodal voltages and reducing renewable power curtailment is demonstrated.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy: Preprint

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoltaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗