Search NASA⌕ Search

SEARCH · Search NASA

Results for “Automation & Control Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Concept of Operations of Next-Generation Traffic Control Utilizing Infrastructure-Based Cooperative Perception: Preprint

This paper puts forth a system architecture for an infrastructure-based cooperative perception (CP) fusion engine, to provide a complete state-space digital representation, with measurable accuracy, to support a wide-range of applications. The architecture includes the inputs, functional flow, data standardization recommendations, outputs and supported applications. The CP engine addresses critical needs with respect to accelerating the benefits of automation through intelligent roadway infrastructure (IRI), that complements and accelerates connected and automated vehicle (CAV) technology. that the CP acquires and fuses information from sensors (radar, LiDAR, and cameras), and CAVs to intelligently perceive roadway traffic states of all moving objects, create a complete three-dimensional digital representation of that state-space, and communicate it to downstream application such as intelligent signal control, safety and energy applications, and cooperate driving applications for CAVs as examples. The IRI approach, as opposed to a vehicle centric approach, is found to be more scalable in that it can deployed to the roughly 300,000 signalized intersections more readily than the over 300 million vehicles in the US, and accrues early-stage benefits equitable to all roadway users addressing safety, equity, fuel efficiency, and GHG reduction.

ADVANCED PROPULSION SYSTEMS↗

Multiphysics Modeling of Microreactors with NEAMS codes, and Validation Based on KRUSTY Reactivity Insertion

The NEAMS Multiphysics Applications team continues to assess code usability and functionality for microreactor design and safety analyses, while demonstrating that NEAMS tools capture both steady-state and transient behavior across distinct microreactor concepts. In FY2025, the team advanced full-core, high-fidelity, multiphysics models that solve more complex problems and strengthen verification/validation for several microreactor systems: heat-pipe microreactor (HPMR), gas-cooled microreactor (GCMR), and the KRUSTY experiment. These models employ the MOOSE MultiApp/Transfers architecture with Griffin for neutronics, BISON for heat conduction/thermomechanics, Sockeye for heat pipes, SAM/THM for coolant channels and loops, and SWIFT for hydride behavior, with meshes generated via the MOOSE Reactor Module. The graphite models available in the Grizzly code were also investigated for future analyses. For the HPMR, a Na-HPMR variant was constructed to align with recently validated heat-pipe experiments and Sockeye’s LCVF capability, enabling mechanistic heat-pipe transients and startup modeling. The Na-HPMR will serve as the primary model for HPMR investigations in upcoming tasks. The load-following and single heat-pipe failure scenarios (Griffin/BISON/Sockeye), which were previously modeled for the K-HPMR, were replicated for the Na-HPMR, showing strong negative temperature feedback and highly localized thermal effects, respectively, while the startup case captured vapor-front progression and heat-removal activation. Solid mechanics was added to the previously built K-HPMR full-core model in BISON, showing minimal impact on steady-state reactivity yet enabling stress-field predictions that prepare the path for full-core TRISO performance analyses. For the GCMR, automated steady-state and four transient scenarios were executed using Griffin/BISON/SAM/SWIFT. Results confirm robust inherent safety: power collapses promptly in loss-of-cooling events, the inlet-temperature drop settles to a new equilibrium, and a single-channel blockage yields only a ~30 K local fuel-temperature rise with <0.4% power decrease. SWIFT-predicted hydrogen redistribution affects reactivity during both steady-state and transient conditions, underscoring its importance. A Brayton-cycle balance of plant (BOP) model in SAM/THM demonstrated stable startup behavior, and xenon-driven reactivity during load following was analyzed. To improve TRISO-compact temperature fidelity, a fast multiscale Heat Source Decomposition (HSD) treatment was implemented. Against heterogeneous benchmarks, HSD reduces underprediction of kernel temperatures and lowers predicted peak powers in reactivity-insertion transients compared to previous homogenized models. KRUSTY warm-critical validation progressed from FY2024 baselines: the 15Ȼ insertion shows excellent agreement in peak power (~2% high) and temperature trends, and the 30Ȼ case was automated via a feedback controller that maintained power near 3 kW for ~150 s with close agreement to data. The successful modeling of the warm critical tests has laid a strong foundation for simulating more complex nuclear system tests in the years ahead. Throughout FY2025, developer feedback was provided (e.g., MOOSE batch mesh generation, distributed pre-split meshes, Griffin sweeper on displaced meshes), several new models were contributed to the Virtual Test Bed, and an OECD-NEA WPRS multiphysics benchmark based on the HPMR was initiated to enable broader cross-comparison and best-practice development with the nuclear community at large.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗

Automated radiotherapy treatment plan integrity verification

Purpose: In our clinic, physicists spend from 15 to 60 min to verify the physical and dosimetric integrity of radiotherapy plans before presentation to radiation oncology physicians for approval. The purpose of this study was to design and implement a framework to automate as many elements of this quality control (QC) step as possible. Methods: A comprehensive computer application was developed to carry out a majority of these verification tasks in the Philips PINNACLE treatment planning system (TPS). This QC tool functions based on both PINNACLE scripting elements and PERL sub-routines. The core of this technique is the method of dynamic scripting, which involves a PERL programming module that is flexible and powerful for treatment plan data handling. Run-time plan data are collected, saved into temporary files, and analyzed against standard values and predefined logical rules. The results were summarized in a hypertext markup language (HTML) report that is displayed to the user. Results: This tool has been in clinical use for over a year. The occurrence frequency of technical problems, which would cause delays and suboptimal plans, has been reduced since clinical implementation. Conclusions: In addition to drastically reducing the set of human-driven logical comparisons, this QC tool also accomplished some tasks that are otherwise either quite laborious or impractical for humans to verify, e.g., identifying conflicts amongst IMRT optimization objectives.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Image processing occupancy sensor

A system and method of detecting occupants in a building automation system environment using image based occupancy detection and position determinations. In one example, the system includes an image processing occupancy sensor that detects the number and position of occupants within a space that has controllable building elements such as lighting and ventilation diffusers. Based on the position and location of the occupants, the system can finely control the elements to optimize conditions for the occupants, optimize energy usage, among other advantages.

42 ENGINEERING↗

Safer and optimized vulnerability scanning for operational technology through integrated and automated passive monitoring and active scanning

Vulnerability scanning of embedded sensors and controllers have a history of causing disruption and malfunction within operation technology environments. Traditional information technology vulnerability scanning generally consists of blunt exercising all or a large population of test conditions to understand how equipment responds. Often the large number and varied conditions of the tests are too much for embedded systems to handle. This paper presents a methodology and framework for integrating passive monitoring and active scanning techniques to optimize the type and amount of necessary active communication tests while achieving acceptable levels of device and vulnerability discovery. Bayesian probability and networks are leveraged for inference to drive the automation of the scanning actions to achieve confidence in discovery. Through inference, selecting the optimal active scans with the least risk and highest confidence impact is possible, thereby eliminating unnecessary scans with uncertain effects. Results of experimenting with real power systems and the following probabilities are provided.

Key Management, ICS, SCADA, Authentication↗

Why Do Electricity Policy and Competitive Markets Fail to Use Advanced PV Systems to Improve Distribution Power Quality?

The increasing pressure for network operators to meet distribution network power quality standards with increasing peak loads, renewable energy targets, and advances in automated distributed power electronics and communications is forcing policy-makers to understand new means to distribute costs and benefits within electricity markets. Discussions surrounding how distributed generation (DG) exhibits active voltage regulation and power factor/reactive power control and other power quality capabilities are complicated by uncertainties of baseline local distribution network power quality and to whom and how costs and benefits of improved electricity infrastructure will be allocated. DG providing ancillary services that dynamically respond to the network characteristics could lead to major network improvements. With proper market structures renewable energy systems could greatly improve power quality on distribution systems with nearly no additional cost to the grid operators. Renewable DG does have variability challenges, though this issue can be overcome with energy storage, forecasting, and advanced inverter functionality. This paper presents real data from a large-scale grid-connected PV array with large-scale storage and explores effective mitigation measures for PV system variability. We discuss useful inverter technical knowledge for policy-makers to mitigate ongoing inflation of electricity network tariff components by new DG interconnection requirements or electricity markets which value power quality and control.

14 SOLAR ENERGY↗

RADIOLOGICAL SURVEY STATION DEVELOPMENT FOR THE PIT DISASSEMBLY AND CONVERSION PROJECT

The Savannah River National Laboratory (SRNL) has developed prototype equipment to demonstrate remote surveying of Inner and Outer DOE Standard 3013 containers for fixed and transferable contamination in accordance with DOE Standard 3013 and 10 CFR 835 Appendix B. When fully developed the equipment will be part of a larger suite of equipment used to package material in accordance with DOE Standard 3013 at the Pit Disassembly and Conversion Project slated for installation at the Savannah River Site. The prototype system consists of a small six-axis industrial robot with an end effector consisting of a force sensor, vacuum gripper and a three fingered pneumatic gripper. The work cell also contains two alpha survey instruments, swipes, swipe dispenser, and other ancillary equipment. An external controller interfaces with the robot controller, survey instruments and other ancillary equipment to control the overall process. SRNL is developing automated equipment for the Pit Disassembly and Conversion (PDC) Project that is slated for the Savannah River Site (SRS). The equipment being developed is automated packaging equipment for packaging plutonium bearing materials in accordance with DOE-STD-3013-2004. The subject of this paper is the development of a prototype Radiological Survey Station (RSS). Other automated equipment being developed for the PDC includes the Bagless transfer System, Outer Can Welder, Gantry Robot System (GRS) and Leak Test Station. The purpose of the RSS is to perform a frisk and swipe of the DOE Standard 3013 Container (either inner can or outer can) to check for fixed and transferable contamination. This is required to verify that the contamination levels are within the limits specified in DOE-STD-3013-2004 and 10 CFR 835, Appendix D. The surface contamination limit for the 3013 Outer Can (OC) is 500 dpm/100 cm2 (total) and 20 dpm/100 cm2 (transferable). This paper will concentrate on the RSS developments for the 3013 OC but the system for the 3013 Inner Can (IC) is nearly identical.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Quantifying element incorporation in multispecies biofilms using nanoscale secondary ion mass spectrometry image analysis

Elucidating nutrient exchange in microbial communities is an important step in understanding the relationships between microbial systems and global biogeochemical cycles, but these communities are complex and the interspecies interactions that occur within them are not well understood. Phototrophic consortia are useful and relevant experimental systems to investigate such interactions as they are not only prevalent in the environment, but some are cultivable in vitro and amenable to controlled scientific experimentation. Nanoscale secondary ion mass spectrometry (NanoSIMS) is a powerful, high spatial resolution tool capable of visualizing the metabolic activities of single cells within a biofilm, but quantitative analysis of the resulting data has typically been a manual process, resulting in a task that is both laborious and susceptible to human error. In this work, the authors describe the creation and application of a semiautomated image-processing pipeline that can analyze NanoSIMS-generated data, applied to phototrophic biofilms as an example. The tool employs an image analysis process, which includes both elemental and morphological segmentation, producing a final segmented image that allows for discrimination between autotrophic and heterotrophic biomass, the detection of individual cyanobacterial filaments and heterotrophic cells, the quantification of isotopic incorporation of individual heterotrophic cells, and calculation of relevant population statistics. The authors demonstrate the functionality of the tool by using it to analyze the uptake of 15 N provided as either nitrate or ammonium through the unicyanobacterial consortium UCC-O and imaged via NanoSIMS. The authors found that the degree of 15N incorporation by individual cells was highly variable when labeled with 15 NH 4 + , but much more even when biofilms were labeled with 15 NO 3 – . In the 15 NH 4 + -amended biofilms, the heterotrophic distribution of 15 N incorporation was highly skewed, with a large population showing moderate 15 N incorporation and a small number of organisms displaying very high 15 N uptake. The results showed that analysis of NanoSIMS data can be performed in a way that allows for quantitation of the elemental uptake of individual cells, a technique necessary for advancing research into the metabolic networks that exist within biofilms with statistical analyses that are supported by automated, user-friendly processes.

59 BASIC BIOLOGICAL SCIENCES↗

Upgrade of Core Conduction Cooldown Test Facility Control System

The CCCTF was designed and installed at ORNL in the 1990s for high-temperature gas-cooled reactor accident simulation. It is located within a modular hot cell housed in the IFEL facility. In 2008 and 2009, modifications were made to the CCCTF in preparation for AGR safety testing. A new airlock was designed and installed to better support periodic exchange of the fission product deposition cups while maintaining the fuel at safety test temperature, and modifications were made to add routines to the existing user interface software for computer-controlled automation of the He sweep gas flow and liquid nitrogen supply to the 85Kr cold traps. However, the furnace control hardware and software remained essentially unchanged. At the conclusion of the AGR-1 and AGR-2 PIE campaigns, continued use of the CCCTF was in question because of the gradual obsolescence of the hardware and software used to control the furnace and ancillary systems that make up the CCCTF. Therefore, an effort was undertaken to replace all the obsolete components with new hardware and update the software to increase system reliability and ensure this capability’s maintenance for future research and fuel qualification efforts. The modifications included creating a new National Instruments (NI) LabVIEW-based control system with a graphical user interface (GUI).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

An automated and portable method for selecting an optimal GPU frequency

Power consumption poses a significant challenge in current and emerging graphics processing unit (GPU) enabled high-performance computing systems. In modern GPUs, dynamic voltage frequency scaling (DVFS) appears to be a reliable control to regulate power consumption and performance. However, the DVFS design space is large - hence, brute-force approaches are infeasible to select the optimal frequency. Furthermore, no single frequency can be universally optimal for applications with varying computational intensities. Thus, the application's complexity and the availability of a wide range of frequency settings are a challenge in selecting the optimal frequency configuration for a given GPU workload. To that end, this paper proposes a systematic approach that consists of three steps. The feature characterization study identifies the fine-grain GPU utilization metrics that influence the power consumption and execution time of a given workload. To understand the performance, power, and energy consumption behaviors of a workload across GPU's DVFS design space, we derived analytical power and performance models using the identified fine-grain features. Here, it is shown that the same set of GPU utilization metrics can estimate both the power consumption and execution time while being agnostic of changes to frequency and input sizes. Applying a power control with the single objective of reducing power may cause performance degradation, leading to more energy consumption. A multi-objective approach is proposed to select the optimal GPU DVFS configuration for a workload that reduces power consumption with negligible degradation in performance. The evaluation was conducted using SPEC ACCEL benchmarks and three real applications - NAMD LAMMPS, and LSTM on NVIDIA GV100, GA100, and AMD MI210 GPUs. On average, real applications showed 29.6% energy savings with a performance loss of 5.2% on GA100 and 22.6% energy savings with a performance loss of 4.7% on GV100. Moreover, the proposed models are portable to real applications, GPU architectures, and vendors, and require metric collection at only the default frequency rather than all supported DVFS configurations. Additionally, we conducted a comparison between our models and the GPU assembly instructions (PTX)-based static models. The results revealed a significant reduction in the average error rates, with a decrease from 19.7% to 3.1% for power models and from 29.4% to 5.2% for performance models.

97 MATHEMATICS AND COMPUTING↗

Engineering Scale Testing of Robotic Inspection Tools for Double Shell Tanks at Hanford - 18349

Waste found in the annulus of the AY-102 double-shell tank (DST) at Hanford has prompted the need for the development of inspection tools that are able to access confined spaces around and underneath the tanks. During the last year, Florida International University (FIU) has been developing inspection tools that are capable of accessing the tank floors through the air supply line, the air refractory channels and the drain lines. This effort has led to the development of a pneumatic pipe crawler and a miniature rover. In this paper, updates to the inspection tool designs and the full scale testing of both systems are presented. The tools provide visual feedback for the operator, carrying with them onboard cameras and light sources. The images are streamed back live via a tether, which also provides power to the devices. To increase the sensing capabilities of both tools, temperature, humidity and radiation sensor modules are being integrated onto the developed systems, and can be interchanged depending on the inspection objectives. The miniature rover measures 7 cm in length and 3.8 cm in width, and travels upside down on the bottom of the tank to avoid debris accumulated in the channels. The video is also being processed real-time to provide control of the unit semi-autonomously. The pipe crawler measures approximately 76 cm in length and 6.4 cm in diameter, and travels using pneumatic actuators that emulate the peristaltic movement contractions typical of worm type robots. A full-scale sectional mock-up of the DST foundation, refractory system and annulus is currently being developed as a test-bed for the testing of the inspection tools. The intention of the test-bed is to demonstrate the viability of using both inspection tools in configurations similar to the actual tank. The test-bed includes a 2.43 m wide section of both tank liners, refractory channels and concrete foundation with drain slots. The test-bed is designed to be modular so that various plate thicknesses can be easily utilized and different refractory configurations can be incorporated. Currently, the refractory channels are of the tree type structure with turns that are approximately 30 degrees. Both inspection tools were demonstrated in the mock-up facility. The miniature rover ran successfully through the drain slots from the annulus to central plenum and had no issues making the 90-degree turns. The peristaltic crawler was able to navigate through the 7.62 cm air supply line from the annulus to the central plenum. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integration of a Smart Outlet-Based Plug Load Management System with a Building Automation System

The growth of and reliance on renewable energy necessitate a multi-pronged approach to achieve grid reliability and economics. As they represent a notable portion of U.S. energy consumption, commercial buildings must play an active role in this effort. Conserving energy and responding to grid conditions through demand flexibility can be achieved through the integration of major building systems. Integration of plug and process loads with lighting and heating, ventilation, and air conditioning systems maximizes the effectiveness of integrated building energy management. In this research, we demonstrate the integration of smart outlets into a building automation system. We cover the installation process as well as the architecture required for smart outlets to communicate data to the building automation system and to receive commands back. After recording power measurements for one week as a baseline, we configured the building automation system to turn the smart outlets on and off according to a set schedule. This resulted in energy savings of 66% during 1 week on 25 plug loads. This work demonstrates that grid-interactive efficient buildings are achievable through building system integration.

building automation system↗

Interaction and Impact Studies for Distributed Energy Resource, Transactive Energy, and Electric Grid, using High Performance Computing ?based Modeling and Simulation

The electric utility industry is undergoing significant transformations in its operation model, including a greater emphasis on automation, monitoring technologies, and distributed energy resource management systems (DERMS). With these changes and new technologies, while driving greater efficiencies and reliability, these new models may introduce new vectors of cyber attack. The appropriate cybersecurity controls to address and mitigate these newly introduced attack vectors and potential vulnerabilities are still widely unknown and performance of the control is difficult to vet. This proposal argues that modeling and simulation (M&S) is a necessary tool to address and better understand these problems introduced by emerging technologies for the grid. M&S will provide electric utilities a platform to model its transmission and distribution systems and run various simulations against the model to better understand the operational impact and performance of cybersecurity controls.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Robust Decentralized State Estimation

The health of a distribution grid is maintained by a distribution management system (DMS). Before the rise of distributed energy resource (DER), the DMS primarily managed the unidirectional power flow through the distribution grid from external sources (e.g. power brought from a large generating plant to the distribution grid by a transmission grid). Now, a typical DMS will utilize distributed energy resource manage systems (DERMS) to account for DER such as rooftop solar, community solar, and wind turbines. Each DERMS is responsible for an area of the distribution grid, issuing commands to the associated real-time automation controller (RTAC) to regulate power flow and maintain health of that section of the grid.

42 ENGINEERING↗

Automated Demand Response Opportunities in Wastewater Treatment Facilities

Wastewater treatment is an energy intensive process which, together with water treatment, comprises about three percent of U.S. annual energy use. Yet, since wastewater treatment facilities are often peripheral to major electricity-using industries, they are frequently an overlooked area for automated demand response opportunities. Demand response is a set of actions taken to reduce electric loads when contingencies, such as emergencies or congestion, occur that threaten supply-demand balance, and/or market conditions occur that raise electric supply costs. Demand response programs are designed to improve the reliability of the electric grid and to lower the use of electricity during peak times to reduce the total system costs. Open automated demand response is a set of continuous, open communication signals and systems provided over the Internet to allow facilities to automate their demand response activities without the need for manual actions. Automated demand response strategies can be implemented as an enhanced use of upgraded equipment and facility control strategies installed as energy efficiency measures. Conversely, installation of controls to support automated demand response may result in improved energy efficiency through real-time access to operational data. This paper argues that the implementation of energy efficiency opportunities in wastewater treatment facilities creates a base for achieving successful demand reductions. This paper characterizes energy use and the state of demand response readiness in wastewater treatment facilities and outlines automated demand response opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Semi-Automatic Geographic Information System Framework for Creating Photo-Realistic Digital Twin Cities to Support Autonomous Driving Research

Digital twin cities are frequently used in vehicle and traffic simulations to render realistic on-road driving scenarios under various traffic and environmental conditions. These digital twins provide a high-fidelity replica of the physical world (e.g., buildings, roads, infrastructures, traffic) to create three-dimensional (3D) virtual-physical environments to support various emerging vehicle and transportation technologies such as connected and automated vehicles. These virtual environments provide a cost-effective digital proving ground to evaluate, validate, and test emerging technologies that include control algorithms, localization, perception, and sensors. Replicating a real-world traffic scenario in a digital twin using a traditional 3D modeling approach is a time-consuming and labor-intensive effort. Here this paper presents a semi-automated spatial framework to construct realistic 3D digital twin cities to support autonomous driving research using readily available geographic information system (GIS) data and 3D prefabricated (prefab) models. We start with a comprehensive review of geospatial data sources of essential digital entities required in a 3D digital twin city and present an integrated GIS-3D modeling pipeline using customized QGIS/GDAL and Blender scripting in Python. The pipeline outputs are realistic 3D digital twin cities compatible with common vehicle simulation software, such as CARLA and IPG CarMaker. The paper closes with a showcase to demonstrate the quality and usability of a digital twin city created to replicate the Shallowford Road corridor in Chattanooga in both Unity and Unreal engine-based virtual environment. The generated digital twin city can be applied to a hardware-in-the-loop simulation environment with an actual testing vehicle to facilitate autonomous driving research.

33 ADVANCED PROPULSION SYSTEMS↗

Role of reinforcement learning for risk-based robust control of cyber-physical energy systems

Critical infrastructures such as cyber-physical energy systems (CPS-E) integrate information flow and physical operations that are vulnerable to natural and targeted failures. Safe, secure, and reliable operation and control of CPS-E is critical to ensure societal well-being and economic prosperity. Automated control is key for real-time operations and may be mathematically cast as a sequential decision-making problem under uncertainty. Emergence of data-driven techniques for decision making under uncertainty, such as reinforcement learning (RL), have led to promising advances for addressing sequential decision-making problems for risk-based robust CPS-E control. However, existing research challenges include understanding the applicability of RL methods across diverse CPS-E applications, addressing the effect of risk preferences across multiple RL methods, and development of open-source domain-aware simulation environments for RL experimentation within a CPS-E context. This article systematically analyzes the applicability of four types of RL methods (model-free, model-based, hybrid model-free and model-based, and hierarchical) for risk-based robust CPS-E control. Problem features and solution stability for the RL methods are also discussed. We demonstrate and compare the performance of multiple RL methods under different risk specifications (risk-averse, risk-neutral, and risk-seeking) through the development and application of an open-source simulation environment. Motivating numerical simulation examples include representative single-zone and multizone building control use cases. Finally, six key insights for future research and broader adoption of RL methods are identified, with specific emphasis on problem features, algorithmic explainability, and solution stability.

24 POWER TRANSMISSION AND DISTRIBUTION↗