Engineering topics

Singhal, Ankit

Publications and source records attributed to Singhal, Ankit.

16 records

DOE OSTI2024

Self-Aware Local Autonomous and Semi-Cooperative Control for Cross-Layered Resilience (SLAC3R)

The objective of this work is to develop and demonstrate novel, adaptive, lightweight algorithms that enable the decision-making agents in a large cyber-physical network to act both autonomously and in collaborative harmony to enforce assured resilience across spatiotemporal layers, even under unforeseen adversarial scenarios (e.g., high- impact-low-probability events). Towards this end, the proposed solution will serve as minimally invasive add-on layers that bridge the existing (faster, reactive) local myopic controls and (slower, predictive) centralized optimization. Importantly, the proposed algorithms will enable the multi-agent network to autonomously and collaboratively enforce resilient operation under no or limited communication environment typical of severe cyber- physical adversarial events. The expected outcome of this effort is a suite of prototype, open-source, software algorithms for safety-aware local autonomous and semi-cooperative control (SLAC3R), demonstrated on networked microgrids (via RD2C/Thrust-1 OPAL-RT testbed).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Robust VAR Capability Curve of DER with Uncertain Renewable Generation

Active distribution system with high penetration of inverter based distributed energy resources(DER), can be utilized for var-related ancillary services at the transmission side interface. In order to utilize the DER flexibility, transmission system operator must be presented the aggregated DER flexibility of distribution system. However, the uncertainty in renewable generation, questions the credibility of aggregated capability curve in practice. In this paper, we incorporate the uncertainty into aggregation process to develop capability curve while preserving the real physics (unbalance and lossy nature) of distribution system. The Resulting capability curve with the associated probability can be harnessed by the TSO for decision making for both planning and operation.

Kar, Aditya Shankar↗

DOE OSTI2024

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Sensitivity-Based Reactive Power Dispatch of DERs to Support Transmission Grid During Emergency

This paper proposes a TSO-DSO framework including DER set-point dispatch using sensitivity analysis. We address all three steps of TSO-DSO integration stating by estimating the capability curve of an unbalanced distribution system and then modeling of capability curve on the transmission side grid and estimating the reactive power needed from DSO during emergencies, and ending by dispatching the requested reactive power from TSO. The proposed interaction framework is tested on an IEEE 37-node distribution network connected to IEEE 9 bus transmission system. The simulation shows that using sensitivity-based dispatch would reduce the number of communication signals between DERs and DSO and that can decrease the risk of communication contingency.

Alkhonain, Ahmed↗

DOE OSTI2023

Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning

This paper presents a novel federated reinforcement learning (Fed-RL) methodology to inject sufficient resiliency into the operations of the network of microgrids. We consider adversarial actions to the voltage and power control loop reference signals at the grid forming (GFM) inverters in the microgrids which are essential to integrate renewable resources. Therefore, we formulate a resilient reinforcement learning training setup that uses these adversarial injections to generate episodic trajectories and train the RL agents to alleviate their impact on performance. To circumvent the concerns about data-sharing and privacy for different owners of the microgrids in the networked setting, we bring in the aspects of the federated operation to propose novel Fed-RL algorithms. As the dynamics of each microgrid are coupled due to electrical interlinks, the conventional federated RL approaches using decoupled independent environments are not applicable, which leads us to propose a multi-agent vertically federated variation of actor-critic algorithms, namely federated soft actor-critic (FedSAC). We have performed numerical simulations on an IEEE 123-bus benchmark test feeder with three microgrids by creating a customized simulation setup by encapsulating the microgrid dynamic simulations in GridLAB-D/HELICS co-simulation platform with the OpenAI Gym environment and validated the proposed resilient and secured learning methodology.

Artificial Intelligence (AI), reinforcement learni↗

DOE OSTI2023

Designing a transactive electric vehicle agent with customer’s participation preference

The proliferation of electric vehicles (EVs) and their inherent flexibility in charging timings make them an asset to improve grid performance. In contrast to direct control by a utility or autonomous price-based charging, the transactive control framework not only provides benefits to both grid and customers but also ensures customer autonomy. In this work, we design a transactive electric vehicle (TEV) agent that incorporates the EV owner’s willingness to trade-off between savings and amenity in form of a slider, where the EV owner’s amenity is characterized as vehicle readiness. Further, a privacy-preserving bidding formulation is proposed that also represents the customer’s transactive preference. A transactive market mechanism is discussed that integrates the TEV Agents into the local retail market and reconciles with the current day-ahead and real-time market structure. It is demonstrated that the proposed slider is able to provide a preferred trade-off between savings and amenity to individual customers. At the same time, the market mechanism is shown to successfully reduce both peak prices and peak demand. A comparative investigation of V1G and V2G technologies with respect to the battery prices is also discussed. It reveals that the V2G does not offer significant additional benefits with current battery prices, but could be promising if battery costs decline in the future.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2023

Advancing Energy Equity Considerations in Distribution Systems Planning

Current distribution system planning (DSP) processes do not explicitly account for energy equity considerations, such as who is most affected by power system burdens, where those burdens are concentrated, and what investments can be made to improve baseline conditions. This paper proposes an iterative framework for advancing energy equity as an objective of the DSP process, showing how measurement strategies, or metrics (informed by conceptual foundations of energy justice), can be applied to benchmark equity performance at various stages. This methodology is applied for equity-aware distributed energy resource (DER) hosting capacity analysis and outage analysis to provide critical insights on infrastructure upgrade decisions compared to a business-as-usual (BAU) case. The analysis is performed on a taxonomy feeder representing the West Coast urban/semi-urban system with augmentation of electric vehicles (EVs) and rooftop solar photovoltaic (PV) generators. The study considers disadvantaged community (DAC) and non-disadvantaged community (NDAC) load regions to enable equity-aware simulations. The results demonstrate how equity-aware planning could reveal the limitations of the traditional DSP process as DAC regions are found to have lower DER hosting capacity and higher outage vulnerability. Overall, this work provides insights on the need to incorporate energy equity as an integral part of the DSP process.

Energy Equity, Distribution System Planning, DER a↗

DOE OSTI2023

Tuning Phase Lock Loop Controller of Grid Following Inverters by Reinforcement Learning to Support Networked Microgrid Operations

The dynamic operation of networked microgrids leads to varying topological configurations and generator commitments and dispatches. These variations correspond to systems with different electrical characteristics. The fixed control gains of high-speed power electronic devices may result in undesirable system performance when the electrical characteristics change significantly. As such, it is necessary to tune the control gains of power electronics devices to adapt to the changing system characteristics. This paper uses observer-based reinforcement learning to automatically tune the proportional-integral (PI) gains of phase lock loop (PLL) controller of grid-following (GFL) inverters to adapt to the changing system strengths, that would be seen in networked microgrid operations. Simulation results using an operational electric distribution system, modeled as networked microgrids, are presented to demonstrate the need and effectiveness of the proposed adaptive controls.

networked microgrids, reinforcement learning, grid↗

DOE OSTI2023

Analyzing Distribution Transformer Degradation with Increased Power Electronic Loads

The influx of non-linear power electronic loads into the distribution network has the potential to disrupt the existing distribution transformer operations. They were not designed to mediate the excessive heating losses generated from the harmonics. To have a good understanding of current standing challenges, a knowledge of the generation and load mix as well as the current harmonic estimations are essential for designing transformers and evaluating their performance. In this paper, we investigate a mixture of essential power electronic loads for a household designed in PSCAD/EMTdc and their potential impacts on transformer eddy current losses and derating using harmonic analysis. Our findings reveal that in the presence of high power electronic loads (especially third harmonics), increasing PV generation may worsen transformer degradation. However, with a low amount of power electronic loads, additional PV generation helps to reduce the harmonic content in the current and improve transformer performance.

eddy current, harmonics, PV, THD, power transforme↗

DOE OSTI2022

High-Performance Transmission and Distribution Co-simulation with 10,000+ Inverter-Based Resources

The inverter-based resource (IBR) has become avery important component in the distribution system. The impacts on system transient stability introduced by high IBR penetration are not fully addressed because of the lack of high-fidelity models. The aggregate IBR model at the transmission level cannot precisely reproduce the dynamics of distributed IBR at the distribution system because of the oversimplification. In this paper, we will develop a high-penetration fully-connected transmission and distribution (T&D) co-simulation platform that supports the simulation of 10,000+ dispersed IBR models. The interfacing and iterative initialization techniques for the co-simulation have been implemented to maintain stable operation and simulation of large-multitude of IBR models. The phasor-domain IBR models with grid-forming (GFM) and grid-following (GFL) control are implemented in the distribution systems simulators. The developed platform is tested on high-performance computing (HPC) resources and can be utilized to explore the hierarchical control strategies of IBRs for the large-scale T&D hybrid system.

Liu, Yuan↗

DOE OSTI2022

Analysis of Distributed Energy Storage as a Core Grid Infrastructure via Production Cost Modeling

Energy storage plays a pivotal role in enabling power system operation with more flexibility and resilience. Unlike current practice that considers energy storages as attached ancillary devices, this paper focuses on storages as a core infrastructure by looking at their spatial distribution in the system. A sensitivity analysis based on production cost modeling is conducted to demonstrate the benefits of distributed energy storages. First, the modeling of energy storages in production cost modeling is presented. Second, potential optimal locations of distributed energy storages in a power system are discussed. Finally, multiple scenarios with various numbers and locations of additional distributed energy storages in the WECC 2030 model are created. The production cost modeling results of these scenarios show that distributed energy storages have higher utilization compared to the centralized ES units and therefore provide significantly more benefits in terms of reduction in generation cost, emission cost, and volatility of location marginal prices. A saturation effect is observed suggesting the selection of optimal locations will further improve the benefits.

Nguyen, Quan H.↗

DOE OSTI2022

Distribution System Planning for Growth in Residential Electric Vehicle Adoption

Anticipated growth in Electric Vehicles (EV) adoption could stress distribution system circuits beyond their original design limits. Uncertainties related to when households will begin buying EVs in large numbers challenges existing distribution system planning approaches and complicates efforts to assess grid impacts. Anticipated location, timing, and demand for EV charging is critical information for distribution system planners as it guides investment strategies for infrastructure upgrades to ensure continued reliability. This research makes two significant contributions: an EV adoption model that uses socioeconomic data to forecast location and year-specific adoption patterns through a bottoms-up approach, and an EV hosting capacity assessment methodology that offers improvements to current utility planning and asset management practices for infrastructure investments. Both contributions are applied to a Southern California Edison feeder in 7 adoption years from 2025 to 2050, with the results indicating that they are likely valuable additions to distribution systems planning capabilities.

Sridhar, Siddharth↗

DOE OSTI2022

Potential for Transactive Energy to Improve the Provisioning of Grid Services from Batteries

This study assessed the degree to which transactive energy systems could help reduce or remove barriers to the deployment of battery energy storage, and realize the full potential of battery resources to supply needed services to the grid and fairly compensate various types of battery owners. To enable this assessment, typical battery deployments were characterized, along with energy markets, Federal Energy Regulatory Commission Order rulings and implementations, grid services, and current deployment barriers. Finally, this study analyzed the value that accrues to batteries supplying today’s grid services as a function of the participation models associated with three primary types of battery ownership: merchant-owned transmission-connected batteries; utility-owned distribution-connected batteries; and customer-owned behind-the-meter batteries. This provided both quantitative and qualitative assessments comparing opportunities for battery storage in business-as-usual and transactive energy scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Data-driven Resilience Characterization of Control Dynamical Systems

In this paper, we define and quantify resiliency of a power network and propose data-driven algorithms for computing the same for the power grid. To do this, we use the Koopman operator framework to lift the controlled dynamical system to an abstract (possibly higher) dimensional space, where the evolution is linear. The linear system representation allows us to relate small time local controllability and observability of a general nonlinear control system to the controllability and observability of the lifted linear system. Finally, we define the resiliency of the underlying power grid in terms of the controllability and observability gramians of the lifted linear system. We illustrate the proposed approach to compute the resiliency metrics on time-series data obtained from a microgrid.

koopman operator, resilience, control↗

DOE OSTI2022

Optimization-Based Resiliency Verification in Microgrids via Maximal Adversarial Set Characterization

Critical energy infrastructures are increasingly relying on advanced sensing and control technologies for efficient and optimal utilization of flexible energy resources. Algorithmic procedures are needed to ensure that such systems are designed to be resilient to a wide range of cyber-physical adversarial events. This paper provides a robust optimization framework to quantify the largest adversarial perturbation that a system can accommodate without violating pre-specified resiliency metrics. We formulate the maximal adversarial set characterization as a bi-level optimization problem which is solved via Lagrangian relaxations.We illustrate the proposed algorithm on an islanded microgrid example: a modified IEEE 123-node feeder with distributed energy resources. Simulations are carried out to characterize the tolerable adversarial perturbations for varying levels of available flexibility (energy reserves).

Nazir, Mohammad Nawaf↗

DOE OSTI2022

Large-Scale Simulation of Regional Demand Flexibility Implementation and Customer Economic Impact

The Distribution System Operator with Transactive (DSO+T) study conducted a large-scale simulation of over 60,000 customers in a region the size of Texas to demonstrate the effective coordination of distributed energy resources (DERs) in commercial and residential buildings. The integrated simulation included both the bulk (wholesale generation and transmission) and distribution systems. The DERs (including batteries, electric vehicles, air conditioning, and water heaters) participated in a transactive energy retail market that was integrated into an existing competitive wholesale market. The engineering and economic performance of the resulting demand flexibility was evaluated over annual simulations for both moderate and high renewable generation scenarios. A detailed parametric cost model was developed to enable detailed economic analysis of key stakeholders. In addition, fixed and dynamic customer tariffs were designed and applied to the customer population. This allowed the impact on annual customer bills to be analyzed for various building types (residential versus commercial; single- versus multi-family). This paper presents results showing the relative flexibility of batteries, electric vehicles, and building loads throughout the year and under different renewable scenarios. This feeds a detailed breakdown of the impact this flexibility has on the operating costs of the grid and the resulting net economic benefit. Finally, the study showed that practically all customer classes (including non-participating customers) save money under the proposed demand flexibility scheme. The study found overall net annual economic savings of $3.3-5.0B for a region the size of Texas equating to average customer bill savings of 10-16%.

Reeve, Hayden M.↗