Search NASA⌕ Search

Engineering topics

Tan, Jie

Publications and source records attributed to Tan, Jie.

Towards intelligent emergency control for large-scale power systems: Convergence of learning, physics, computing and control

Here, this paper has delved into the pressing need for intelligent emergency control in large-scale power systems, which are experiencing significant transformations and are operating closer to their limits with more uncertainties. Learning-based control methods are promising and have shown effectiveness for intelligent power system control. However, when they are applied to large-scale power systems, there are multifaceted challenges such as scalability, adaptiveness, and security posed by the complex power system landscape, which demand comprehensive solutions. The paper first proposes and instantiates a convergence framework for integrating power systems physics, machine learning, advanced computing, and grid control to realize intelligent grid control at a large scale. Our developed methods and platform based on the convergence framework have been applied to a large (more than 3000 buses) Texas power system, and tested with 56 000 scenarios. Our work achieved a 26% reduction in load shedding on average and outperformed existing rule-based control in 99.7% of the test scenarios. The results demonstrated the potential of the proposed convergence framework and DRL-based intelligent control for the future grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

pnnl/MBDRL

Model-based Deep Reinforcement Learning for Real-time Grid Emergency Voltage Control. A model-based Deep Reinforcement Learning (DRL) framework where a deep neural network (DNN)-based surrogate model is utilized within the control policy learning framework, making the learning process faster and more sample efficient

Yin, Tim↗

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Bidentate Ligand-Induced Oriented Transformation of CsPbBr 3 Perovskite Nanocrystals into Nanowires for X-ray Photodetectors

We report shape and dimensionality control by ligands is an efficient way to fabricate high-quality perovskite nanocrystals (NCs) with optoelectronic properties. Herein, to realize oriented transformations between different morphologies of CsPbBr 3 nanocrystals, we conceived of the use of defects and bidentate ligands to synergistically drive the reorientation of CsPbBr3nanocrystals into CsPbBr 3 nanowires (NWs). By employing aminocaproic acid as the bidentate ligand, CsPbBr 3 NWs were reconstructed from the CsPbBr 3 NCs (~7 nm) with 20-60 nm in width and several micrometers in length, as well as a 527 nm photoluminescence (PL) peak, 59% PL quantum yield, and 98.5 ns PL lifetime. The bidentate ligand-directed anisotropic shape evolution and growth of perovskite NWs from NCs was elucidated by transmission electronmicroscopy and PL studies. The photodetectors fabricated with the reconstructed CsPbBr 3 NWs displayed a photocurrent enhancement (2.75 × 10 -11 A) compared with that of the devices based on solution-synthesized NWs (2.28 × 10 -11 A). The device also showed a short response time, indicating its more sensitive photoelectric response. This process provides a viable approach to engineering diverse morphologies of perovskite nanocrystals for optoelectronic applications.

36 MATERIALS SCIENCE↗

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Safe Reinforcement Learning for Emergency Load Shedding of Power Systems

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid’s security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power systems have revealed outstanding issues in terms of either speed, adaptiveness, or scalability of the existing control methods for power systems. On the other hand, the availability of massive real-time data can provide a clearer picture of what is happening in the grid. Recently, deep reinforcement learning (RL) has been regarded and adopted as a promising approach leveraging massive data for fast and adaptive grid control. However, like most existing machine learning (ML)- based control techniques, RL control usually cannot guarantee the safety of the power systems. In this paper, we introduce a novel method for safe RL-based load shedding of power systems that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Numerical simulation on the IEEE 39-bus testcase is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

reinforcement learning, emergency control, power g↗

Physics-Informed Evolutionary Strategy Based Control for Mitigating Delayed Voltage Recovery

Here, in this work we propose a novel data-driven, real-time power system voltage stability control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to secure system voltage stability. The problem is challenging due to the high-dimensional feature of the power system model and the fast-changing and uncertain nature of power system operation scenarios. To this end, a model-free and derivative-free guided ES method is applied. The method is further combined with a meta-learning strategy to make the learnt control policy automatically adapted to unseen operation conditions and fault scenarios, which is highly desired for real-time emergency control. Last but not least, physical knowledge is embedded in the above method through a trainable action mask technique to rule out unnecessary load shedding actions for better learning and control performance. Case studies on the IEEE 300-bus system and comparisons with other state-of-the-art benchmark methods verify the superiority of the proposed physics-informed guided meta ES method in realizing fast and adaptive power system voltage stability control.

42 ENGINEERING↗

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Power system emergency control is generally regarded as the final safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived “worst” case scenarios or a few typical operation scenarios. These schemes are facing significant adaptiveness and robustness issues as increasing uncertainties and variations occur in modern electrical grids. To address these challenges, for the first time, this paper proposes a novel adaptive emergency control scheme using deep reinforcement learning (DRL), by leveraging the high-dimensional feature extraction and non-linear generalization capabilities DRL has for complex systems with high-dimensional variations. Furthermore, an open-source platform named DeepGrid has been designed for the first time to assist the DRL development and benchmarking processes in power system emergency control. Details of the platform, DRL, and emergency control schemes that use dynamic braking or under-voltage load shedding are presented. Extensive case studies performed in both two-area four-machine system and IEEE 39-Bus system have demonstrated the excellent performance and robustness of the proposed schemes.

Deep reinforcement learning, emergency control, lo↗

Characterization of γδ regulatory T cells from peripheral blood in patients with multiple myeloma

γδ regulatory T cells are able to inhibit the activation and function of T cells involved in antigen-specific immune responses. This study aimed to investigate the potential role of γδ regulatory T cells in inhibiting anti-tumor immune responses in patients diagnosed as multiple myeloma (MM). We measured the levels of γδ T cells, the distribution and clonally amplified TCR Vγ and VδT cells in peripheral blood of healthy donors, patients recently diagnosed with MM, and MM patients in remission cohorts. In addition, we evaluated the ability of γδ regulatory T cells to inhibit the proliferation of CD4+CD25- T cells and detected the expression of immunoregulatory-associated molecules. We found that the levels of γδ regulatory T cells from the peripheral blood in patients of MM were significantly higher than those in healthy donors. Comparison of γδT regulatory cells function in MM and healthy donors showed similarly inhibitory effects on the proliferation of T cells. Additionally, TLR8 expression level increased significantly in MM patients compared to healthy donors, while the expression levels of Foxp3, CD25, CTLA4, GITR, GATA3 and Tbet in MM patients and healthy donors showed no significant difference. Taken together, our study reveals the potential role of γδ regulatory T cells in inhibiting anti-tumor immune responses in MM patients.

60 APPLIED LIFE SCIENCES↗

First-principles study of the effect of phosphorus on nickel grain boundary

Based on first-principles quantum-mechanical calculations, the impurity-dopant effects of phosphorus on Σ5(012) symmetrical tilt grain boundary in nickel have been studied. The calculated binding energy suggests that phosphorus has a strong tendency to segregate to the grain boundary. Phosphorus forms strong and covalent-like bonding with nickel, which is beneficial to the grain boundary cohesion. However, a too high phosphorus content can result in a thin and fragile zone in the grain boundary, due to the repulsion between phosphorus atoms. As the concentration of phosphorus increases, the strength of the grain boundary increases first and then decreases. Obviously, there exists an optimum concentration for phosphorus segregation, which is consistent with observed segregation behaviors of phosphorus in the grain boundary of nickel. This work is very helpful to understand the comprehensive effects of phosphorus.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Irradiation-induced magnetic ordering in SiC: Experimental results and a density functional study

Magnetism of 6H-SiC single crystals implanted with 3 MeV protons is studied both experimentally and theoretically. We found that proton irradiation can induce stable ferromagnetism in 6H-SiC with a Curie temperature above 300 K. There is a dose window available for tuning the magnetization of the samples. The maximum saturation magnetizations (0.17 emu/g) are three orders of magnitude larger than that reported in neutron-irradiated SiC crystals (1 × 10{sup −4} emu/g). First-principles calculations indicate that the ferromagnetism is related to the divacancy-related defects (V{sub Si}V{sub C} + nH, (n = 1–3)) generated under proton irradiation. This offers a promising route for the development of metal-free SiC magnets.

36 MATERIALS SCIENCE↗

Development of Face Gear Technology for Industrial and Aerospace Power Transmission

Tests of a 250 horsepower proof-of-concept (POC) split torque face gear transmission were completed by The Boeing Company in Mesa, Arizona, while working under a Defense Advanced Research Projects Agency (DARPA) Technology Reinvestment Program (TRP) This report provides a summary of these cooperative tests, which were jointly funded by Boeing and DARPA Design, manufacture and testing of the scaled-power TRP split torque gearbox followed preliminary evaluations of the concept performed early in the program The testing demonstrated the theory of operation for the concentric, tapered face gear assembly The results showed that the use of floating pinions in a concentric face gear arrangement produces a nearly even torque split The POC split torque tests determined that, with some improvements, face gears can be applied effectively in a split torque configuration which yields significant weight, cost and reliability improvements over conventional designs.

Heath, Gregory F.↗