Search NASA⌕ Search

SEARCH · Search NASA

Results for “intelligent control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Development of intelligent control module for the J-TEXT electron cyclotron emission imaging system

An Electron Cyclotron Emission Imaging (ECEI) system has been developed on the J-TEXT tokamak and employed for the multi-dimensional electron temperature fluctuation imaging measurement in 2019 campaign. The intelligent control module has been developed and been used to flexibly setup the 256-channel ECEI system configurations for different plasma scenarios. The adjustments of key parameters are merged in this module including size and position of the geometric observation window, and the dynamic range of the signal and image resolution. The user-friendly interface is also developed for the tokamak operator to set the ECEI system focusing on physics interested region. Furthermore, this module is installed close to the diagnostic system around the J-TEXT tokamak, which can be remotely controlled by authorized operators in the control room. It significantly improves ECEI flexibility and stability, and also keeps the operation technician away from the harsh radiation environment.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Intelligent Control of Thermal Energy Storage in the Manufacturing Sector for Plant-Level Grid Response

Industrial facilities are seeking new strategies that help in providing savings mechanisms for demand charges. Demand charges are the charges incurred by industrial facilities as a result of power usage. Thermal energy storage has advanced significantly with lots of new applications, garnering the interest of many industrial facilities. These applications could be used to shave the industrial facilities’ peak electric demand and reduce their demand charges. This paper aims to demonstrate the efficacy of thermal energy storage in reducing demand charges and highlight new developments in the integration of smart control systems with thermal energy storage. The study compares energy consumption and peak demand for a facility equipped with and without thermal energy storage tanks using a fixed schedule for charging and discharging. Additionally, the paper examines the impact of incorporating a smart controller to determine when to charge and discharge the tank based on the facility’s real-time power usage and a given setpoint. The results indicate cost savings from the use of thermal energy storage tanks under two proposed scenarios, reflected in the reduced cost of power consumption for the studied facility. The incorporation of a smart controller with the thermal energy storage tank in the facility studied could provide estimated savings of 3.3% per year of power consumption charges, without considering the contribution of any incentives. The estimated savings provided by the fixed schedule scenario are 2.7% per year.

25 ENERGY STORAGE↗

Electricity Pricing aware Deep Reinforcement Learning based Intelligent HVAC Control

Recently, deep reinforcement learning (DRL) based intelligent control of Heating, Ventilation, and Air Conditioning (HVAC) has gained a lot of attention due to DRL's ability to optimally control HVAC for minimizing operational cost while maintaining resident's comfort. The success of such DRL-based techniques largely depends on the articulation of the problem in terms of states, actions, and reward function. Inclusion of the electricity pricing information in the problem formulation can play an important role in saving the cost of HVAC operation. However, less attention has been given in the literature on formulating well-crafted state features based on electricity pricing. In this work, we propose an approach for training the DRL model with a specific focus on feature engineering based on electricity pricing. During training, we generate random but sufficiently realistic electricity price signals so that the pre-trained DRL model is robust and adaptive to the dynamic and variable electricity prices. The validation results are encouraging and show the potential of ≈12%-15% savings in the one day cost of HVAC operation, proving the usefulness of including electricity pricing related features as state features.

Kurte, Kuldeep↗

Towards intelligent emergency control for large-scale power systems: Convergence of learning, physics, computing and control

Here, this paper has delved into the pressing need for intelligent emergency control in large-scale power systems, which are experiencing significant transformations and are operating closer to their limits with more uncertainties. Learning-based control methods are promising and have shown effectiveness for intelligent power system control. However, when they are applied to large-scale power systems, there are multifaceted challenges such as scalability, adaptiveness, and security posed by the complex power system landscape, which demand comprehensive solutions. The paper first proposes and instantiates a convergence framework for integrating power systems physics, machine learning, advanced computing, and grid control to realize intelligent grid control at a large scale. Our developed methods and platform based on the convergence framework have been applied to a large (more than 3000 buses) Texas power system, and tested with 56 000 scenarios. Our work achieved a 26% reduction in load shedding on average and outperformed existing rule-based control in 99.7% of the test scenarios. The results demonstrated the potential of the proposed convergence framework and DRL-based intelligent control for the future grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Deep reinforcement learning with online data augmentation to improve sample efficiency for intelligent HVAC control

Deep Reinforcement Learning (DRL) has started showing success in real-world applications such as building energy optimization. Much of the research in this space utilized simulated environments to train RL-agent in an offline mode. Very few research have used DRL-based control in real-world systems due to two main reasons: 1) sample efficiency challenge---DRL approaches need to perform a lot of interactions with the environment to collect sufficient experiences to learn from, which is difficult in real systems, and 2) comfort or safety related constraints---user's comfort must never or at least rarely be violated. In this work, we propose a novel deep Reinforcement Learning framework with online Data Augmentation (RLDA) to address the sample efficiency challenge of real-world RL. We used a time series Generative Adversarial Network (TimeGAN) architecture as a data generator. We further evaluated the proposed RLDA framework using a case study of an intelligent HVAC control. With a ≈28% improvement in the sample efficiency, RLDA framework lays the way towards increased adoption of DRL-based intelligent control in real-world building energy management systems.

Kurte, Kuldeep↗

Application of Intelligent Load Control to Manage Building Loads to Support Rapid Growth of Distributed Renewable Generation

Electricity utilities are faced with the mounting challenge of providing a stable supply of power to meet the growing demand while also integrating rapid growth in distributed variable renewable generation. Traditional means of balancing short- and long-term supply and demand imbalance will be expensive. Alternative approaches of using flexible loads in buildings are needed to mitigate the imbalance at a lower cost. This paper shows how the intelligent load control (ILC) process can be used to manage loads in buildings by dynamically prioritizing loads for curtailment using both quantitative and qualitative criteria. The ILC process can be deployed on low-cost computing platforms without the need for any additional sensing. ILC was first validated in a simulation environment to provide two grid service use cases: (1) managing monthly peak electricity demand and (2) managing buildings’ electricity consumption during a capacity bidding event. After being successfully tested in a simulation environment, ILC was deployed on real buildings to manage electricity consumption to provide two different use cases under different outdoor operating conditions. Both the simulation tests and the real building experiments were deployed using VOLTTRON™, a distributed sensing and control platform. The results from the tests and experiments showed that ILC was able to manage the controllable loads (heat pumps) in the building to maintain the electricity consumption at the desired level without a significant impact on occupant comfort. Overall, the results demonstrate that the ILC allows coordination of the controllable loads and provides a more intelligent means of load management than the traditional duty-cycling approach.

Kim, Woohyun↗

Intelligent Consequence Control by Aerial Reconnoiter Using Unmanned Systems

In a nuclear accident, or in the aftermath of an improvised nuclear device or radiological dispersal device detonation, radioactive materials may pose a severe health threat to individuals near the site of the incident. The Intelligent Consequence Control by Aerial Reconnoiter Using Unmanned Systems (ICARUS) does the dull, dirty, and dangerous (and, sometimes, deep) work of mapping and characterizing valuable information to enable a safe and appropriate response. ICARUS provides timely answers to the questions, “What is it?” “Where is it?”, and “How far does it extend?” Using commercial, off-the-shelf proven components, the integrated chemical, biological, radiological, nuclear, and explosives detection architecture for our drones provides a solution for collecting radiological, chemical, and optical information on developing complex situations, returning actionable data for determining if it is safe for further response efforts. ICARUS can determine and transmit the location, identity, and intensity of radionuclide contamination to a remote base station. It can deliver on the unexpected.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Comparative analysis of model-free and model-based HVAC control for residential demand response

In this paper, we present a comparative analysis of model-free reinforcement learning (RL) and model predictive control (MPC) approaches for intelligent control of heating, ventilation, and air-conditioning (HVAC). Deep-Q-network (DQN) is used as a candidate for model-free RL algorithm. The two control strategies were developed for residential demand-response (DR) HVAC system. We considered MPC as our golden standard to compare DQN's performance. The question we tried to answer through this work was, What % of MPC's performance can be achieved by model-free RL approach for intelligent HVAC control?. Based on our test result, RL achieved an average of ≈ 62% daily cost saving of MPC. Considering the pure optimization and model-based nature of MPC methods, the RL showed very promising performance. We believe that the interpretations derived from this comparative analysis provide useful insights to choose from various DR approaches and further enhance the performance of the RL-based methods for building energy managements.

Kurte, Kuldeep↗

Deep Reinforcement Learning Based HVAC Control for Reducing Carbon Footprint of Buildings

In this paper, we present our work on deep reinforcement learning (DRL) based intelligent control of Heating, Ventilation, and Air Conditioning (HVAC) with the goal of reducing carbon emission. We performed this task using 1) Marginal Operating Emission Rates (MOER), where the objective was to shift the demand to the low emission period of the day and 2) Time-Of-Use (TOU) demand-response price where the objective was to shift the demand to low price period of the day. This was achieved by learning an optimal pre-cooing strategy. We found the carbon emission reduction in the range of 6%-16% depending on the opportunity presented by the MOER signal. Similarly, we observed the carbon emission reduction in the range of 23%-29% during the peak price period when TOU price was used. The results clearly demonstrated the applicability of our approach in reducing the carbon footprint of the building.

carbon emission↗

Building Energy Systems as Behind-the-Meter Resources for Grid Services: Intelligent load control and transactive control and coordination

To mitigate the impacts of climate change, significant reductions in emissions from all sectors of the economy are needed. The electricity generation sector has embarked on an ambitious plan to include renewable generation as part of its decarbonization efforts, and many cities and states are mandating all-electric buildings. While renewable resources will reduce emissions, they are not dispatchable, they vary temporally, and their generation is uncertain. Under these conditions, traditional approaches to managing grid reliability, where supply follows demand, will not be efficient and may not be cost-effective. Further, there is a more efficient alternative for balancing the supply–demand imbalance and for absorbing variability and uncertainty of renewable energy using distributed energy resources (DERs) as opposed to reserve generation. Because buildings consume more than 75% of total U.S. annual electricity consumption, behind-the-meter (BTM) DERs have a load flexibility of 77 GW of power and 90 GWh of virtual energy storage capacity nationwide (Kalsi, 2017). Therefore, some portion of the supply–demand imbalance can be met by these DERs at a lower cost compared to business-as-usual solutions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development and Validation of a Simulation Testbed for the Intelligent Building Agents Laboratory (IBAL) Using TRNSYS

This paper documents the development and validation of a dynamic primary cooling and thermal storage system simulation testbed. The system simulation testbed, sIBAL, is based on the Intelligent Building Agents Laboratory (IBAL) at the National Institute of Standards and Technology (NIST), which is a research infrastructure and testbed for the development, evaluation, and demonstration of intelligent control algorithms. The sIBAL testbed developed in this project will serve as a virtual twin of the real facility for future control algorithm development. The details of the methodologies used to develop and validate the simulation testbed, which replicates the dynamic behaviors of the primary cooling and ice storage system in the IBAL facility, are presented. The simulation testbed was developed in TRNSYS using built-in component models and MATLAB functions to replicate the two water-cooled chillers, a thermal storage tank, pumps, valves and other components for four different operation modes. Experiments on IBAL components were designed and executed to generate experimental data for model development and verification of the simulation platform. The validation of the simulation results was carried out in two phases: 1) independent component simulations for the chillers and thermal storage tank, and 2) a combined testbed simulation of the entire hydronic system. Comparison of simulation results to the experimental data obtained from the IBAL facility showed errors within 1 °C for the temperatures outputs of both the chiller and the thermal storage model. The error is within an acceptable range for further intelligent control algorithms development. The findings from the study are summarized and presented along with areas where additional research is needed. In addition, data filtering procedures and model refinement measures utilized to improve the accuracy and accelerate the computation time of the simulation are presented.

cooling systems↗

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗