Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Brazil's Action Plan for Rapid Decarbonization of Power Sectors

A collaborative report from the Clean Energy Ministerial (CEM) on Lessons Learned for Rapid Decarbonization of Power Sectors was delivered to energy ministers and presented at the CEM13 in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several jurisdictions signaled intent to develop Action Plans for power sector decarbonization. The first cohort of Action Plans was released at CEM14 in India in July 2023. The second cohort of action plans will be presented at CEM15 in Brazil. The Action Plans, supported by the 21st Century Power Partnership, and other CEM workstreams via direct technical assistance and capacity building, are intended to focus on select implementation actions, given each country's existing power sector goals and activities, and are an opportunity for countries to display leadership in power sector decarbonization. The Action Plans are organized in a framework for Planning, Building and Operating, as well as Stakeholder Engagement where appropriate based on country priorities. They complement, but are differentiated from, other international power sector initiatives such as the Breakthrough Agenda (whose broad purpose is to raise collective ambition) and the Global Power System Transformation Consortium (whose goals are to convene power system operators to accelerate research innovations and foster peer learning). These Action Plans are voluntary, developed by each country individually, not comprehensive of all activities within the jurisdiction, and are living documents that are subject to change.

21st Century Power Partnership↗

5G integrated edge computing platform for efficient component monitoring in coal-fired power plants

This project developed a cutting-edge 5G-integrated edge computing framework to enhance operational efficiency and reliability in coal-fired power plants through real-time component monitoring and anomaly detection. The initiative focused on leveraging distributed machine learning, federated learning, and 5G-based dynamic network slicing to support scalable, fault-tolerant monitoring environments to meet the operational requirements in industrial control systems. With a Distributed Edge Computing Service (DECS) orchestration, this project enabled federated learning at edge for condition monitoring and introduced adaptive client selection strategies to minimize communication overhead. Scalable distributed training was achieved using the Horovod framework, thus enhancing performance across edge nodes. In the realm of 5G networking, the project designed and deployed reconfigurable, QoS-aware network slicing tailored for operational technology (OT) environments, integrating software-defined networks to bolster cyber-resilience and enabling dynamic slicing for federated learning workloads. A significant milestone was the development of a virtualized ICS environment with 5G core integration—which allowed elastic and fault tolerant distributed training on real-world datasets such as NASA Bearings, Hydraulic Systems, and TEP. To broaden the impact of the project, a TRL-3 virtualized ICS testbed for research and education was designed. This project engaged several graduate and undergraduate students to conduct research on the cutting-edge technology, and it resulted in one PhD dissertation, one MS thesis, and over 14 peer-reviewed publications. With the support of this project students also participated in national cybersecurity competitions to improve their professional development skills.

20 FOSSIL-FUELED POWER PLANTS↗

Divertor detachment and heat exhaust mitigation control in KSTAR with tungsten divertor

KSTAR has recently undergone an upgrade to use a new tungsten divertor to run experiments in ITER-relevant scenarios. Even with a high melting point of tungsten, it is important to control the heat flux impinging on tungsten divertor targets to minimize sputtering and contamination of the core plasma. Heat flux on the divertor is often controlled by increasing the degree of detachment of scrape-off layer plasma from the target plates. In this work, we have demonstrated successful divertor detachment and heat exhaust dissipation control experiments using two different methods. The first method uses attachment fraction as a control variable which is estimated using ion saturation current measurements from embedded Langmuir probes in the divertor. The second method uses a novel machine-learning-based surrogate model of 2D UEDGE simulation database, DivControlNN. We demonstrated running inference operation of DivControlNN in realtime to estimate heat flux at the divertor and use it as the control variable in a feedback loop with impurity gas flow. We present interesting insights from these experiments including a systematic approach to tuning controllers and discuss future improvements in the control infrastructure and control variables for future burning plasma experiments.

KSTAR tungsten divertor operations↗

Using Artificial Intelligence to Improve Reliability and Operational Efficiency of Small-Scale Hydroelectric Distributed Generation

Reliability and resilience are critical concerns for distributed generation (DG) at the rural electric level. The integration of renewable energy sources, such as small-scale hydroelectric distributed generators (hydro DGs), introduces operational challenges, particularly regarding aging infrastructure and grid stability. Artificial Intelligence (AI)-driven Machine Learning (ML) models and applications of Large Language Models (LLMs) offer promising solutions for optimizing DG operations and enhancing resilience. This paper explores AI-based models for improving efficiency, fault resolution, and outage mitigation in small-scale hydro DGs. Furthermore, it highlights the development of a centralized, AI-powered information portal for rural electric cooperatives and municipalities. The research evaluates hydro DG plant models and discusses the applicability of AI-powered question-answering tools for real-time operations, focusing on statistical data, load flow, voltage regulation, and generation power. The findings demonstrate AI’s potential to transform DG management to ensure greater stability and resilience in rural electric grids.

Bhattacharyya, Arjun [ORNL] (ORCID:000900060976046↗

Perspectives on Machine Learning-assisted Plasma Medicine: Towards Automated Plasma Treatment

Cold atmospheric plasmas (CAPs) have shown great promise for medical applications through their synergistic chemical, electrical, and thermal effects, which can induce therapeutic outcomes. However, safe and reproducible plasma treatment of complex biological surfaces poses a major hurdle to the widespread adoption of CAPs for medical applications. Predictive modeling of the mutual interactions between the plasma and biological surfaces and, thus, systematic approaches to quantify and predict plasma treatment outcomes remain largely elusive due to the lack of mechanistic understanding of plasma-surface interactions that can span across vastly different length-and time-scales. In addition, real-time sensing capabilities in biomedical CAP devices are often limited, which can be detrimental to plasma treatment due to the intrinsic plasma and surface variability during the treatment, as well as sensitivity to external perturbations. All of these challenges can make reproducible and effective plasma treatment of biological surfaces difficult to realize, which is further compounded by errors due to human operation of hand-held CAP devices. Machine learning and data-driven approaches can be particularly useful in addressing these challenges in three major ways: (i) data-driven modeling of hard-to-model plasma-surface interactions and plasma treatment outcomes; (ii) learning data analytics for plasma and surface diagnostics in real-time; and (iii) developing predictive controllers that enable reliable and effective CAP treatments. Furthermore, this paper discusses the promise of machine learning to accelerate plasma medicine research in these areas, toward machine learning-assisted and automated CAP treatment of complex biological surfaces.

60 APPLIED LIFE SCIENCES↗

Outlook towards deployable continual learning for particle accelerators

Particle accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization and control, anomaly detection and machine protection. With recent advancements, machine learning (ML) holds promise to assist in more advance prognostics, optimization, and control. While ML based solutions have been developed for several applications in particle accelerators, only few have reached deployment and even fewer to long term usage, due to particle accelerator data distribution drifts caused by changes in both measurable and non-measurable parameters. In this paper, we identify some of the key areas within particle accelerators where continual learning can allow maintenance of ML model performance with distribution drifts. Particularly, we first discuss existing applications of ML in particle accelerators, and their limitations due to distribution drift. Next, we review existing continual learning techniques and investigate their potential applications to address data distribution drifts in accelerators. By identifying the opportunities and challenges in applying continual learning, this paper seeks to open up the new field and inspire more research efforts towards deployable continual learning for particle accelerators.

43 PARTICLE ACCELERATORS↗

Uruguay's Action Plan and Experience for Power Sector Decarbonization

A collaborative report from the Clean Energy Ministerial (CEM), Lessons Learned for Rapid Decarbonization of Power Sectors, was delivered to energy ministers and presented at the 13th CEM (CEM13) in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several jurisdictions signaled intent to develop Action Plans for power sector decarbonization. The first cohort of Action Plans was released at CEM14 in India in July 2023. The Uruguay Ministry of Industry, Energy and Mining is pleased to release this Action Plan as a contribution to the second cohort of Action Plans released at CEM15 in Brazil in October 2024. The Action Plans, supported by the 21st Century Power Partnership, and other CEM workstreams via direct technical assistance and capacity building, are intended to focus on select implementation actions given each country's existing power sector goals and activities, and are an opportunity for countries to display leadership in power sector decarbonization. The Action Plans are organized in a framework for planning, building, and operating, as well as stakeholder engagement where appropriate based on country priorities. They complement, but are differentiated from, other international power sector initiatives such as the Breakthrough Agenda (whose broad purpose is to raise collective ambition) and the Global Power System Transformation Consortium (whose goals are to convene power system operators to accelerate research innovations and foster peer learning). These Action Plans are voluntary, developed by each country individually, not comprehensive of all activities within the jurisdiction, and are living documents that are subject to change.

21st Century Power Partnership↗

Improving the Transportability of a Deep Learning Denoising Model Using Transfer Learning Techniques

The adoption of machine learning techniques in the seismology community has led to great performance improvements in several areas, including signal processing. Specifically, the development of deep learning–based seismic waveform denoising models has the potential to yield improvements in signal detection capabilities for networks operating in particularly noisy environments. Recent advancements in the design of these deep learning denoising models have included the incorporation of continuous and discrete wavelet transform functions into the network architecture to improve the learning capabilities and efficiency of said models. These wavelet transform–based seismic denoising models have shown improved denoising capabilities in regions where there is good agreement between the data features present in the training and evaluation datasets. However, questions remain about the overall transportability of these models to other monitoring regions. Here, in this study, we will determine the baseline transportability of a newly developed multilevel wavelet‐transform convolutional neural network (MWCNN) seismic denoising model. We accomplish this by taking a version of the MWCNN denoising model trained on data collected from the Utah region and evaluating its denoising performance on datasets collected from the neighboring Nevada region, which differ with regard to monitoring sensor types and event histories. We find that there is a notable variability in denoising performance related to the degree of similarity between the initial and new target datasets. The most notable difference in denoising performance is the ability of the denoising model to preserve accurate amplitude information associated with the signal energy present in the waveform data. Finally, we evaluate the ability of transfer learning techniques to improve the transportability of the MWCNN denoising model. We find that although there is still a performance gap present in the denoising results of the MWCNN model, transfer learning did yield improved results.

Quinones, Louis [Sandia National Laboratories (SNL↗

Canada's Underground Research Laboratory (1980-2014) - 16274

In 1980, Canada initiated a long-term, comprehensive research and development program of geologic characterization and large-scale in situ geotechnical experiments in a subsurface facility, the Underground Research Laboratory (URL). The URL was excavated specifically to evaluate the concept of permanent disposal of used CANDU{sup R} nuclear reactor fuel in a deep geological repository (DGR) constructed in Canadian Shield granite. Key phases of the URL included siting, detailed site characterization and monitoring, construction, operation, decommissioning, and closure. Much collaborative research with international organizations was undertaken at the URL and continues, even after the closure of the facility, through the ongoing Enhanced Sealing Project (ESP). The ESP monitors the engineered performance of a full-scale composite shaft seal that was emplaced during URL closure to permanently seal the main URL access shaft across a sub-horizontal hydraulically active fracture zone. Currently the ESP is jointly funded by Canadian Nuclear Laboratories (CNL) (Canada), Posiva (Finland), and Andra (France), and monitoring is planned to continue until the end of 2016. Decades of programmatic experience at the URL have shown that knowledge continuity is integral to supporting the development of a safe geological disposal facility for high level nuclear waste. This paper outlines the history of the URL and describes some technical lessons learned from its 30-plus years of construction, operation, and closure activities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

TU-C-12A-12: Differentiating Bone Lesions and Degenerative Joint Disease in NaF PET/CT Scans Using Machine Learning

Purpose: [F-18]NaF PET can be used to image bone metastases; however, tracer uptake in degenerative joint disease (DJD) often appears similar to metastases. This study aims to develop and compare different machine learning algorithms to automatically identify regions of [F-18]NaF scans that correspond to DJD. Methods: 10 metastatic prostate cancer patients received whole body [F-18]NaF PET/CT scans prior to treatment. Image segmentation resulted in 852 ROIs, 69 of which were identified by a nuclear medicine physician as DJD. For all ROIs, various PET and CT textural features were computed. ROIs were divided into training and testing sets used to train eight different machine learning classifiers. Classifiers were evaluated based on receiver operating characteristics area under the curve (AUC), sensitivity, specificity, and positive predictive value (PPV). We also assessed the added value of including CT features in addition to PET features for training classifiers. Results: The training set consisted of 37 DJD ROIs with 475 non-DJD ROIs, and the testing set consisted of 32 DJD ROIs with 308 non-DJD ROIs. Of all classifiers, generalized linear models (GLM), decision forests (DF), and support vector machines (SVM) had the best performance. AUCs of GLM (0.929), DF (0.921), and SVM (0.889) were significantly higher than the other models (p<0.001). GLM and DF, overall, had the best sensitivity, specificity, and PPV, and gave a significantly better performance (p<0.01) than all other models. PET/CT GLM classifiers had higher AUC than just PET or just CT. GLMs built using PET/CT information had superior or comparable sensitivities, specificities and PPVs to just PET or just CT. Conclusion: Machine learning algorithms trained with PET/CT features were able to identify some cases of DJD. GLM outperformed the other classification algorithms. Using PET and CT information together was shown to be superior to using PET or CT features alone. Research supported by the Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗

Convolutional Neural Network–Aided Temperature Field Reconstruction: An Innovative Method for Advanced Reactor Monitoring

In this study, the capabilities of a physics-informed convolutional neural network (CNN) for reconstructing the temperature field from a limited set of measurements taken at the boundaries of internal flows are demonstrated. Such an approach enables the development of less invasive monitoring methods for real-time plant diagnostics. As a test case, a Molten Salt Fast Reactor (MSFR) design was selected. This circulating fuel reactor has received interest from both scientific and industrial communities due to its intrinsic safety and sustainability. Molten salt flows in such reactors, however, can present highly localized temperature peaks that can induce significant thermal stresses onto the vessel walls. At these local maxima, the salt temperature may exceed a thousand kelvins, which makes a direct measurement challenging or even unfeasible. The proposed CNN algorithm allows one to detect indirectly such discontinuities through an accurate, albeit indirect, temperature measurement method during reactor operation. The datasets employed to train and test the machine learning models in the present work were generated with Nek5000, a computational fluid dynamics (CFD) code developed at Argonne National Laboratory. The CNN algorithm is trained with CFD results that span a set of MSFR operational power and flow ranges. Here, to demonstrate the efficacy of the algorithm, predictions are made for test cases contained within the training range but for which the CFD data were not used when training. Results demonstrate that the proposed technique properly characterizes temperature peaks and distributions within the domain for a broad range of scenarios.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗

Nuclear Safety [Vol. 33, No. 1, January-March 1992]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 1 Technical Note: A New Approach to Fission Reactor Safety, Yu. V. Petrov; 5 Erratum; ACCIDENT ANALYSIS: 6 Analysis and Modeling of Fission Product Release from Various Uranium-Aluminum Plate-Type Reactor Fuels, R. P. Taleyarkhan; CONTROL AND INSTRUMENTATION: 23 Applications of a Surveillance and Diagnostics Methodology Using Neutron Noise From a Pressurized-Water Reactor, R. T. Wood, L. F. Miller, and R. B. Perez; DESIGN FEATURES: 36 Westinghouse Advanced Passive 600 Plant, B. A. McIntyre and R. K. Beck; 47 System 80+™ PWR Safety Design, C. W. Bagnal, R. A. Matzie, and R. S. Turk; ENVIRONMENTAL EFFECTS: 58 The MATS Experiments—Mesoscale Atmospheric Transport Studies at the Savannah River Site, A. H. Weber, S. Berman, R. J. Kurzeja, and R. P. Addis; 75 Book Review: Environmental Radioactivity in the European Community 1984-1985-1986, C. A. Little; WASTE AND SPENT FUEL MANAGEMENT: 76 Activities Related to Waste and Spent Fuel Management, M. D. Muhlheim and E. G. Silver; OPERATING EXPERIENCES: 87 Aging Assessment of BWR Control Rod Drive Systems, R. H. Greene; 100 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 103 Selected Safety-Related Events, Compiled by G. A. Murphy; 110 Operating U.S. Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver; RECENT DEVELOPMENTS: 129 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 139 Reports, Standards, and Safety Guides, D. S. Queener; 143 Proposed Rule Changes as of Sept. 30 1991; ANNOUNCEMENTS: 128 Harvard School of Public Health Announces Short Courses; 128 16th Biennial ANS Topical Meeting on Reactor Operating Experience: Present and Future Technologies—Applying Lessons Learned (Call for Papers); 147 The Authors; 150 Indexes to Nuclear Safety, Volume 32; 154 Errata.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Nuclear Safety [Vol. 33, No. 1, January-March 1992]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 1 Technical Note: A New Approach to Fission Reactor Safety, Yu. V. Petrov; 5 Erratum; ACCIDENT ANALYSIS: 6 Analysis and Modeling of Fission Product Release from Various Uranium-Aluminum Plate-Type Reactor Fuels, R. P. Taleyarkhan; CONTROL AND INSTRUMENTATION: 23 Applications of a Surveillance and Diagnostics Methodology Using Neutron Noise From a Pressurized-Water Reactor, R. T. Wood, L. F. Miller, and R. B. Perez; DESIGN FEATURES: 36 Westinghouse Advanced Passive 600 Plant, B. A. McIntyre and R. K. Beck; 47 System 80+™ PWR Safety Design, C. W. Bagnal, R. A. Matzie, and R. S. Turk; ENVIRONMENTAL EFFECTS: 58 The MATS Experiments—Mesoscale Atmospheric Transport Studies at the Savannah River Site, A. H. Weber, S. Berman, R. J. Kurzeja, and R. P. Addis; 75 Book Review: Environmental Radioactivity in the European Community 1984-1985-1986, C. A. Little; WASTE AND SPENT FUEL MANAGEMENT: 76 Activities Related to Waste and Spent Fuel Management, M. D. Muhlheim and E. G. Silver; OPERATING EXPERIENCES: 87 Aging Assessment of BWR Control Rod Drive Systems, R. H. Greene; 100 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 103 Selected Safety-Related Events, Compiled by G. A. Murphy; 110 Operating U.S. Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver; RECENT DEVELOPMENTS: 129 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 139 Reports, Standards, and Safety Guides, D. S. Queener; 143 Proposed Rule Changes as of Sept. 30 1991; ANNOUNCEMENTS: 128 Harvard School of Public Health Announces Short Courses; 128 16th Biennial ANS Topical Meeting on Reactor Operating Experience: Present and Future Technologies—Applying Lessons Learned (Call for Papers); 147 The Authors; 150 Indexes to Nuclear Safety, Volume 32; 154 Errata.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Physics-Informed Reinforcement Learning Framework for Economic-Thermal Co-Optimization of Crypto Mining Data Centers: Preprint

The rapid expansion of cryptocurrency mining has created a new class of high-density data centers characterized by extreme thermal flux and high sensitivity to volatile economic markets. Traditional thermal management strategies, typically reliant on rule-based control, maintain static setpoints that fail to account for fluctuating electricity prices and cryptocurrency values - factors critical to mining profitability. To address this, we present a physics-informed reinforcement learning (PIRL) framework for economic-thermal co-optimization in crypto mining data centers. This framework consists of a proximal policy optimization (PPO) agent, a virtual testbed powered by high-fidelity physics-based models, and an interactive frontend dashboard. The PPO agent is trained using the virtual testbed and strict hardware safety limits. This physics-informed approach allows the agent to learn a stochastic policy that dynamically balances mining revenue against operational costs by co-optimizing HVAC cooling setpoints and IT computational hashrate. The simulation results demonstrate that the integrated framework achieved an 8.62% increase in net operational profit compared to traditional baseline strategies while strictly adhering to safety-critical temperature constraints (coolant supply temperature < 32 degrees C). This work provides a scalable template for the deployment of reinforcement learning in mission critical facilities where economic volatility and physical safety must be managed simultaneously.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Use of Machine Learning on PMU Data for Transmission System Fault Analysis

Synchrophasor technology has been used for monitoring, control, and protection of bulk power system for over 10 years. Deployment of phasor measurement units (PMUs) in the USA power system has surpassed 3000 units installed in the transmission substations as stand-alone intelligent electronic devices (IEDs) or as a software add-on to other devices such as digital protective relays (DPRs) or digital fault recorders (DFRs). By now, thousands of terabytes of PMU data may have been captured and stored by various transmission system operators (TSOs) and independent system operators (ISOs). This creates an opportunity to deploy advanced machine learning (ML) techniques to detect and classify faults recorded by PMUs automatically to be used by the system operators for rapid, critical decision-making when manual analysis of the past or unfolding events is not feasible. In this paper we offer a brief background on how the automated fault analysis may be done using DPR and/or DFR data, and compare some of the legacy approaches to the new ML approaches in the context of the system-wide PMU recordings. We then offer insights from developing practical ML solutions that have been applied on field recordings captured by close to 450 PMUs from all three US interconnections (Western, Eastern and ERCOT) over two years (2016-2017). We identify and illustrate ML challenges we addressed: inaccurate data, data with scarce and temporally imprecise fault labels, data recorded by PMUs sparsely located at substations resulting in the fault records taken afar from the ends of the faulted lines, data containing only positive sequence values, and data taken at different voltage levels. We then illustrate the ML model results for fault analysis under different application scenarios. The novelty of this study is not only in the design, implementation, and performance analysis of the ML algorithms, but also in the use of advanced fault modelling and simulation approaches to improve the training results when developing supervised ML models for fault detection and classification. Extensive simulations of faults were conducted on a 14-bus power system to create a training dataset with over 1400 accurately labelled faults. This dataset was applied to enhance the accuracy of fault detection and classification of machine learning-based models trained with small number of labelled faults in large datasets recorded in the grid interconnections ranging from 5,000 to 70,000 buses.

Synchrophasors, Machine Learning, Fault Analysis, ↗