Search NASA⌕ Search

Engineering topics

Cao, Di

Publications and source records attributed to Cao, Di.

A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

Here, this study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.

97 MATHEMATICS AND COMPUTING↗

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

This paper proposes a model-free decentralized control framework for the voltage regulation of large-scale distribution systems through the coordinated control of PV inverters. This is achieved by developing a novel interaction mechanism between the surrogate model and the centralized training and decentralized execution multiagent deep reinforcement learning framework. Specifically, the sparse Gaussian processes regression method is first utilized to develop the surrogate model of the original distribution system for reward calculation during the training stage, where each agent represents a sub-region in the centralized fashion for coordination strategy learning. After that, the learned control rules are used to inform controllers within each sub-region for real-time decisions with only local measurements. Comparative tests among various methods on the EPRI Ckt5 test system demonstrate the effectiveness of the proposed method.

distribution system↗

Model-Free Voltage Control of Active Distribution System with PVs Using Surrogate Model-Based Deep Reinforcement Learning

Accurate knowledge of the distribution system topology and parameters is required to achieve good voltage control performance, but this is difficult to obtain in practice. This paper proposes a physical-model-free voltage control method based on a surrogate-model-enabled deep reinforcement learning approach. Specifically, a surrogate model is trained in a supervised manner using the recorded limited number of historical data to learn the relationship between the power injections and voltage fluctuations of each node. Then, the deep reinforcement learning algorithm is applied to learn an optimal control strategy from the experiences obtained by continuous interactions with the surrogate model. The proposed method can achieve physical-model-free control of unbalanced distribution network and inform real-time decisions to deal with fast voltage fluctuations caused by the rapid variation of PV generation. Simulation results on an unbalance IEEE 123-bus system show that the proposed method can achieve similar performance as that of perfect physical-model-based approaches while being advantageous over other traditional methods.

active distribution network↗

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Robust Deep Gaussian Process-Based Probabilistic Electrical Load Forecasting Against Anomalous Events

The abnormal events, such as the unprecedented COVID-19 pandemic, can significantly change the load behaviors, leading to huge challenges for traditional short-term forecasting methods. This article proposes a robust deep Gaussian processes (DGP)-based probabilistic load forecasting method using a limited number of data. Since the proposed method only requires a limited number of training samples for load forecasting, it allows us to deal with extreme scenarios that cause short-term load behavior changes. In particular, the load forecasting at the beginning of abnormal event is cast as a regression problem with limited training samples and solved by double stochastic variational inference DGP. The mobility data are also utilized to deal with the uncertainties and pattern changes and enhance the flexibility of the forecasting model. The proposed method can quantify the uncertainties of load forecasting outcomes, which would be essential under uncertain inputs. Extensive comparison results with other state-of-the-art point and probabilistic forecasting methods show that our proposed approach can achieve high forecasting accuracies with only a limited number of data while maintaining the excellent performance of capturing the forecasting uncertainties.

anomalous events↗

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗

Microstructure and properties of Cu-Sn-Zn-TiO 2 nano-composite coatings on mild steel

Cu-Sn-Zn coatings have been widely used in industry for their unique properties, such as good conductivity, high corrosion resistance and excellent solderability. To further improve the mechanical performance of Cu-Sn-Zn coatings, powder-enhanced method was applied and Cu-Sn-Zn-TiO 2 nano-composite coatings with different TiO 2 concentration were fabricated. The microstructure of Cu-Sn-Zn-TiO 2 nano-composite coatings were investigated by X-ray diffraction (XRD) and Scanning Electron Microscopy (SEM). The mechanical properties of coatings including microhardness and wear resistance were studied. The results indicate that the incorporation of TiO 2 nanoparticle can significantly influence the properties of Cu-Sn-Zn coatings. The microhardness of Cu-Sn-Zn coating was increased to 383 HV from 330 HV with 1 g/L TiO 2 addition. Also, the corrosion resistance of coating was enhanced. The effects of TiO 2 nanoparticle concentration on the microstructure, mechanical properties and corrosion resistance of Cu-Sn-Zn-TiO 2 nano-composite coatings were discussed.

36 MATERIALS SCIENCE↗

Valproate induced hepatic steatosis by enhanced fatty acid uptake and triglyceride synthesis

Steatosis is the characteristic type of VPA-induced hepatotoxicity and may result in life-threatening hepatic lesion. Approximately 61% of patients treated with VPA have been diagnosed with hepatic steatosis through ultrasound examination. However, the mechanisms underlying VPA-induced intracellular fat accumulation are not yet fully understood. Here we demonstrated the involvement of fatty acid uptake and lipogenesis in VPA-induced hepatic steatosis in vitro and in vivo by using quantitative real-time PCR (qRT-PCR) analysis, western blotting analysis, fatty acid uptake assays, Nile Red staining assays, and Oil Red O staining assays. Specifically, we found that the expression of cluster of differentiation 36 (CD36), an important fatty acid transport, and diacylglycerol acyltransferase 2 (DGAT2) were significantly up-regulated in HepG2 cells and livers of C57B/6J mice after treatment with VPA. Furthermore, VPA treatment remarkably enhanced the efficiency of fatty acid uptake mediated by CD36, while this effect was abolished by the interference with CD36-specific siRNA. Also, VPA treatment significantly increased DGAT2 expression as a result of the inhibition of mitogen-activated protein kinase kinase (MEK) – extracellular regulated kinase (ERK) pathway; however, DGAT2 knockdown significantly alleviated VPA-induced intracellular lipid accumulation. Additionally, we also found that sterol regulatory element binding protein-1c (SREBP-1c)-mediated fatty acid synthesis may be not involved in VPA-induced hepatic steatosis. Overall, VPA-triggered over-regulation of CD36 and DGAT2 could be helpful for a better understanding of the mechanisms underlying VPA-induced hepatic steatosis and may offer novel therapeutic strategies to combat VPA-induced hepatotoxicity. - Highlights: • VPA induced hepatic steatosis and modulated genes associated with lipid metabolism. • CD36-mediated fatty acid uptake contributed to VPA-induced lipid accumulation. • PA increased the hepatic level of DGAT2 through inhibiting MEK-ERK pathway and enhanced triglyceride synthesis. • SREBP-1c-mediated fatty acid synthesis was not involved in VPA-induced hepatic steatosis.

60 APPLIED LIFE SCIENCES↗

Electronic Sensitivity of Carbon Nanotubes to Internal Water Wetting

We have constructed devices in which the interior of a single-walled carbon nanotube (SWCNT) field-effect transistor acts as a nanofluidic channel that connects two fluid reservoirs, permitting measurement of the electronic properties of the SWCNT as it is wetted by an analyte. Wetting of the inside of the SWCNT by water turns the transistor on, while wetting of the outside has little effect. These observations are consistent with theoretical simulations that show that internal water both generates a large dipole electric field, causing charge polarization of the tube and metal electrodes, and shifts the valance band of the SWCNT, while external water has little effect.

Cao, Di↗

Translocation of Single-Stranded DNA Through Single-Walled Carbon Nanotubes

We report the fabrication of devices in which one single-walled carbon nanotube spans a barrier between two fluid reservoirs, enabling direct electrical measurement of ion transport through the tube. A fraction of the tubes pass anomalously high ionic currents. Electrophoretic transport of small single-stranded DNA oligomers through these tubes is marked by large transient increases in ion current and was confirmed by polymerase chain reaction analysis. Each current pulse contains about 10{sup 7} charges, an enormous amplification of the translocated charge. Carbon nanotubes simplify the construction of nanopores, permit new types of electrical measurements, and may open avenues for control of DNA translocation.

59 BASIC BIOLOGICAL SCIENCES↗