Search NASA⌕ Search

Engineering topics

Zhao, Junbo

Publications and source records attributed to Zhao, Junbo.

71 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Power system inertia estimation: Review of methods and the impacts of converter-interfaced generations

Understanding and quantifying the inertia of power systems with the integration of converter-interfaced generation (CIG) plays an essential role in the safe transition to a future low-inertia scenario. Here we provide a comprehensive summary of inertia definitions for both synchronous generators and CIGs as well as their corresponding estimation methods. In particular, the estimation methods are categorized as model-based and measurement-based approaches considering both small and large disturbances. The advantages and disadvantages of different methods are carefully discussed. This paper also offers for the first time a framework to quantify the virtual inertia of CIGs at the component and aggregation levels, an open problem in the literature. Finally, future directions for inertia estimation are identified and discussed. This significantly benefits the design of appropriate control and protection schemes in achieving a more reliable, secure, and resilient power system.

42 ENGINEERING↗
DOE OSTI2021

A Generalized Copula-Polynomial Chaos Expansion for Probabilistic Power Flow Considering Nonlinear Correlations of PV Injections

This paper develops a generalized Copula-polynomial chaos expansion (PCE) framework for power system probabilistic power flow that can handle both linear and nonlinear correlations of uncertain power injections, such as wind and PVs. A data-driven Copula statistical model is used to capture the correlations of uncertain power injections. This allows us to resort to the Rosenblatt transformation to transform correlated variables into independent ones while preserving the dependence structure. This paves the way of leveraging the PCE for surrogate modeling and uncertainty quantification of power flow results, i.e., achieving the probabilistic distributions of power flows. Simulations carried out on the IEEE 57-bus system show that the proposed framework can get much more accurate results than other alternatives with different linear and nonlinear power injection correlations.

copula↗
DOE OSTI2021

Roles of Dynamic State Estimation in Power System Modeling, Monitoring and Operation

—Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the implementation differences between the two, including the measurement configuration, modeling framework and support software features. The important roles of DSE are discussed from modeling, monitoring and operation aspects for today’s synchronous machine dominated systems and the future power electronics-interfaced generation systems. Several examples are presented to demonstrate the benefits of DSE on enhancing the operational robustness and resilience of 21st century power system through time critical applications. Future research directions are identified and discussed, paving the way for developing the next generation of energy management systems.

Zhao, Junbo↗
DOE OSTI2021

Global Sensitivity Analysis of Large Distribution System with PVs using Deep Gaussian Process

Global sensitivity analysis (GSA) of the voltage to uncertain power injection variations plays an important role for appropriate Volt-VAR optimization. This paper proposes a data-driven GSA method for large-scale distribution systems with a large number of uncertain sources. Specifically, the deep Gaussian process is used to identify the mapping relationship between uncertain power injections and voltages. This allows us to resort to the analysis of variance framework to calculate the Sobol indices for GSA. Unlike the existing polynomial chaos expansion and Gaussian process-based approaches, our proposed method has much better scalability. Test results on the EPRI 1747-node K1 circuit with a different number and different probability distributions of uncertain sources demonstrate that the proposed method can achieve accurate GSA under various conditions.

14 SOLAR ENERGY↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2021

A Data-Driven Global Sensitivity Analysis Framework for Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution systems with respect to stochastic PV and load variations plays an important role in designing optimal voltage control schemes. This paper proposes a data-driven framework for GSA of distribution systems. In particular, two representative surrogate modeling-based approaches are developed, including the traditional Gaussian process-based and the analysis of variance (ANOVA) kernel ones. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol indices can be conveniently calculated through either the sampling-based method or the analytical method to assess the global sensitivity of voltage to variations of PV and load power injections. The sampling-based method approximates the Sobol indices using Monte Carlo simulations while the analytical method calculates them by resorting to the ANOVA expansion framework. Comparison results with other model-based GSA methods on the unbalanced three-phase IEEE 37-bus and 123-bus distribution systems show that the proposed framework can achieve much higher computational efficiency with negligible loss of accuracy. The results on a real 240-node distribution system using actual smart meter data further validate the feasibility and scalability of the proposed framework.

14 SOLAR ENERGY↗
DOE OSTI2021

MPC-based double-layer real-time conditional cSelf-restoration for interconnected microgrids

In this report, we propose a novel model predictive control(MPC)-based real-time conditional self-restoration energy management system (CSR-EMS) for interconnected microgrids (IMGs) integrated with renewable energy sources (RESs) and energy storage systems (ESSs). Superior to the existing IMG self-restoration methods, the “conditionality” of the proposed CSR-EMS can economically realize self-restoration and grid-assisted restoration during energy deficiency or faults, in both islanded and grid-connected modes. Cost minimization is implemented as the objective function to judge in real-time which restoration mode is economically preferred. The proposed CSR-EMS comprises two layers–the lower layer operates locally to eliminate electricity fluctuations created by RESs and ensure economic effectiveness within an MG, whereas the upper layer oversees the real-time operational status of the IMG system and determines power exchange among microgrids (MGs) during abnormalities. In detail, when a microgrid inside the IMG system experiences an energy deficiency, the CSR-EMS, on an MPC basis, intelligently optimizes power production from each dispatchable distributed generator (DG), ESS, power imported from the main grid, and power exchange among the IMGs to maintain the demand–supply balance, while considering system recovery cost, state of charge (SoC) of ESSs and operation modes of the IMGs (i.e., grid-connected or islanded mode). Simulation results and comparisons with existing IMG self-healing EMSs demonstrate the economic efficacy of the proposed CSR-EMS strategy during normal and abnormal operations, which can be used as an energy control framework for modern power systems with multiple interconnected microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗
DOE OSTI2021

Nonlinear Virtual Inertia Control of WTGs for Enhancing Primary Frequency Response and Suppressing Drivetrain Torsional Oscillations

Virtual inertia controllers (VICs) for wind turbine generators (WTGs) have been recently developed to compensate the reduction of inertia in power systems. However, VICs can induce drivetrain torsional oscillations of WTGs. This paper addresses this issue and develops a novel nonlinear VIC based on objective holographic feedback theory and the definition of a completely controllable system of Brunovsky type. Simulation results under various scenarios demonstrate that the proposed technique outperforms existing VICs in terms of enhancement of system frequency nadir, suppression of WTG drivetrain torsional oscillations, fast and smooth recovery of WTG rotor speed to the original maximum power point (MPP) before the disturbance as well as preventing secondary frequency dip caused by traditional VIC. The proposed technique is also able to adaptively coordinate multiple WTGs to enhance the frequency support and the dynamic performance of each WTG.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Robust Adaptive Decentralized Dynamic State Estimation with Unknown Control Inputs using Field PMU Measurements

This paper proposes a robust adaptive decentralized dynamic state estimation method for power system with unknown inputs of the highly detailed synchronous machine model. The temporal and spatial correlations among the unknown inputs are used to derive a vector auto-regressive model. The latter is further integrated together with state transition and measurement models for joint state and unknown inputs estimation. Thanks to the consideration of implicit cross-correlations between the states and the unknown inputs, only generator terminal voltage and current phasors are needed. Test results on the US WECC system using the field PMU measurements show that the proposed method is able to track both the system dynamic states and unknown controller inputs. These information could significantly benefit the validation and calibration of generator controller parameters.

Zhao, Junbo↗
DOE OSTI2020

Robust PCA-Deep Belief Network Surrogate Model for Distribution System Topology Identification with DERs

With the expansion of distribution networks and increased penetration of distributed energy resources (DERs), it is becoming increasingly important to obtain accurate distribution network topology in real-time. In this paper, a robust principal component analysis coupled deep belief network (PCA-DBN) surrogate model is proposed for distribution system topology identification. It integrates the benefits of robust feature extraction from PCA to deal with data quality issues and filter out noise, and the strength of DBN in capturing the nonlinear relationship between voltage amplitudes and the binary states of switchable connections. This also significantly reduces the DBN training complexity without loss of accuracy. It is shown that the widely used standard deviation of voltage drop and the voltage covariance matrix features yield less accuracy as compared to that of the voltage amplitudes in presence of high penetration of DERs and ZIP loads. Comparison results with other alternatives, such as the random forest (RF), multi-output regression (MOR) and the traditional DBN methods demonstrate that the proposed method can achieve a much higher topology identification accuracy while maintaining robustness to missing data and measurement noise under various penetration levels of DERs.

deep belief network↗
DOE OSTI2020

Application of Detectability Analysis for Power System Dynamic State Estimation

To guide the measurement placement and selection for dynamic state estimation in power systems, it is important to determine the existence of an observer that can estimate the dynamic states. Past studies have been focused on observability analysis, which determines whether the initial states can be uniquely determined. In this paper, detectability analysis is proposed to determine whether the current states can be estimated as time involving. Through the proposed detectability analysis, the states of an unobservable system can be categorized into the detectable states and undetectable states. It is shown that if the eigenvalues corresponding to the unobservable states are stable, the states are detectable and their estimates will converge to the true ones asymptotically. The study can be used to guide measurement placement and selection.

Detectability, dynamic state estimation↗
DOE OSTI2020

Robust Medium-Voltage Distribution System State Estimation using Multi-Source Data

Due to the lack of sufficient online measurements for distribution system observability, pseudo-measurements from short-term load or distributed renewable energy resources (DERs) forecasting are used. However, the accuracy of them is low and thus significantly limits the performance of distribution system state estimation (DSSE). In this paper, a robust DSSE that integrates multi-source measurement data is proposed. Specifically, the historical low-voltage (LV) side smart meters are used to forecast load and DERs injections via the support vector machine (SVM) with optimally tuned parameters. By contrast, the online smart meters at LV side are utilized to derive equivalent power injections at the MV/LV transformers, yielding more accurate pseudo-measurements compared to the forecasted injections. Furthermore, to deal with bad data caused by communication loss, instrumental errors and cyber attacks, robust DSSE that relies on generalized maximum-likelihood (GM)-estimation criterion is developed. The projection statistics are developed to adjust the weights of each measurement, leading to better balance between pseudo- and real-time measurements. Numerical results conducted on modified IEEE 33-bus system with DG integration demonstrate the effectiveness and robustness of the proposed method.

distribution system state estimation↗
DOE OSTI2020

Correlation-Aided Robust Decentralized Dynamic State Estimation of Power Systems with Unknown Control Inputs

This paper proposes a correlation-aided robust adaptive unscented Kalman filter for power system decentralized dynamic state estimation with unknown inputs, termed as robust AUKF-UI. The temporal and spatial correlations among the unknown inputs are used to derive a vector auto-regressive (VAR) model in an adaptive manner. This VAR model is further integrated together with state transition and measurement models for joint state and unknown inputs estimation. This allows taking into account the implicit cross-correlations between the states and the unknown inputs. As a result, the rank requirement for unknown input vector estimation is relaxed and the local generator frequency measurement is not required. The temporal correlations of time series innovation vectors, predicted state and input vectors are also leveraged by the robust AUKFUI to detect, identify and process bad data. Without these correlations, it is very challenging to address bad data with unknown inputs. Simulation results carried out on the IEEE 39-bus system demonstrate that the proposed robust AUKF-UI achieves much better results than other methods in the presence of low measurement redundancy, strong nonlinearity, and bad data.

Zhao, Junbo↗
DOE OSTI2020

Risk-Oriented PMU Placement Approach in Electric Power Systems

The objective of traditional PMU placement approaches is to use the minimal number of PMUs to cover system complete observability. Very few consider the probability and the consequence severity of observability loss. For example, following line trip, grid topology changes, which may results in observability loss and overloaded lines. As long as the overloaded lines are still observable, then we can take action in time to correct the system; and the consequence of the observability loss is not severe, although some parts of the system is not observable. Otherwise, if the overloaded lines become unobservable, then we lose the situation awareness of the system and the consequence of the observability loss is severe. To address the above points in PMU placement, this paper proposes a risk-oriented PMU placement approach. The proposed approach uses two indices, namely the probability of observability loss and its corresponding consequence of severity to design the optimal PMU placement strategy. We show that our proposed approach is able to capture the critical events while the traditional approaches fail to do so. Extensive simulation results carried out on the IEEE 39-bus and 118-bus systems demonstrate its effectiveness.

observability, risk of observability loss, PMUs pl↗