Search NASA⌕ Search

Engineering topics

Zandi, Helia

Publications and source records attributed to Zandi, Helia.

Energy performance evaluation of the ASHRAE Guideline 36 control and reinforcement learning–based control using field measurements

This study evaluates the energy performance of ASHRAE Guideline 36–compliant control (ASHRAE 36 control) and reinforcement learning (RL)–based control through experimental field tests and a simulation study. Three field tests were conducted at Oak Ridge National Laboratory’s commercial building test facility in Oak Ridge, Tennessee: a baseline with a baseline conventional control, a test with ASHRAE 36 control, and a test with RL-based control. The selected ASHRAE 36 controls were trim and respond control, as well as variable air volume (VAV) box control. We compared the measured supply air temperature of the rooftop unit, VAV box supply air temperature, and VAV box supply airflow rate across the three test cases. The field data indicated that ASHRAE 36 controls operated as specified by ASHRAE Guideline 36. Based on these data, ASHRAE 36 control achieved a 45 % reduction in hourly averaged HVAC energy consumption compared with the baseline, and RL-based control achieved a 66 % reduction. These potential annual energy savings were confirmed using a calibrated whole-building energy model. Compared with the baseline, ASHRAE 36 control reduced HVAC energy consumption by 42 %, and RL-based control achieved a 54 % reduction. Furthermore, RL-based control reduced total HVAC energy consumption by 21 % more than ASHRAE 36 control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Synchronization and Rebound Effects in Residential Loads

Increasing fuel prices and capacity investment deferral place an increasing demand for peak reduction from distribution level systems. Residential and commercial devices, such as HVAC systems and water heaters, are increasingly involved in load control programs, and their use may generate synchronization and rebound effects, such as artificial peaks caused by device optimization. While there have been concerns over device synchronization, few studies quantify the extent of this effect with numerical values. In this study, we attempt to investigate whether control efforts result in device synchronization or rebound effects. We focus on three clustering methods – Ward’s clustering, Euclidean K-means, and Density-based spatial clustering of applications with noise – to evaluate the extent of synchronization of a fleet of water heaters and HVAC systems in Atlanta, Georgia. Our findings show that synchronization and rebound effects are present in the neighborhood’s water heaters, but none were found in the HVAC systems. Further, high usage water heaters are more susceptible to synchronization and rebound effects.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Transfer Learning Strategy for Improving the Data Efficiency of Deep Reinforcement Learning Control in Smart Buildings

Reinforcement learning (RL) is a powerful tool that has shown promising results in many domains such as robotics and game-playing. Because RL algorithms learn optimal control policies by continuously interacting with their environments, these algorithms require a lot of data to learn, which limits their application to a wide range of domains. For this reason, there is an immense need for improving the training and data efficiency of RL. Towards addressing this research gap, this paper proposes a transfer learning (TL) approach to improve the efficiency of the RL algorithms by reducing data need and, thus, reducing training time. To demonstrate the proposed approach, a knowledge transfer from a set of buildings to another building was conducted. The results show that the proposed TL approach is a promising method that can efficiently harness the information from similar RL tasks and reduce the data needs of RL algorithms.

Amasyali, Kadir↗

Autonomous Anomaly Detection for MPC Forecasts of HVAC Systems in Residential Communities

The use of residential heating, ventilation, and air conditioning (HVAC) to shift peak demand or provide ancillary services is a potential solution in the presence of older grids and distributed renewables. However, to ensure the efficient use of devices, utilities need to accurately forecast the load and adopt error correction schemes when necessary. While significant theoretical research exists in the area of predictive control of HVAC, little experimental evidence exists. The lack of experimental data in turn causes researchers to be unprepared for unsystematic errors which emerge due to the higher complexity of the data generating process. This study offers an anomaly detection methodology that uses unsupervised machine learning algorithms to detect and isolate these errors with different forecast error ranges. The results of anomaly detection procedure can then be used for error correction and would eventually help develop better predictive controllers. The methodology is tested using real world data from a smart neighborhood that currently operates in Atlanta. GA.

Lebakula, Viswadeep↗

Structural Differences between Morning and Evening Peak in Optimized Water Heaters

Peak reduction is an important concern that can help reduce the growing stress on distribution grids and allow to defer investments in new capacity. Water heaters represent a convenient way of reducing peak, depending on controllability of devices. But while controlling water heaters does allow to shift peak, it also results in rebound effects, which require additional understanding before water heater fleets can be used on a large scale. We attempt to investigate the nature of peak behaviors of water heaters and demonstrate that water heaters are not homogenous in their behavior. Depending on the overall intensity of the use of water, part of the population has higher rebound effect, while part of the population has little or no rebound effect. Even though we do not have sufficient data to statistically evaluate our findings, we use a sample of 42 water heaters in a connected neighborhood to provide an early attempt at discovering and reporting this diversity.

Tsybina, Eve↗

Anomaly detection for MPC forecast in Fleet of Water Heaters

Among residential devices, water heaters consume 20% of home energy use in the United States. Water heaters possess the capability to store energy within their reservoirs, enabling the ability to decouple energy use from hot water use. This capability can be used to reduce energy usage and costs while also supporting grid services. This requires accurate forecasting of the parameters of the water heater such as upper and lower temperatures. In this study, we analyzed the performance and behavior of a water heater model used in the real-world to predict a control mechanism that is implemented in a smart residential neighborhood. The model forecasts are accurate in most cases but not all. In such scenarios, error correction of the model is necessary to further improve model predictive control accuracy. Anomaly detection is the first step of error correction. This study complements existing research by grouping time series data into two clusters one with anomalies and another without anomalies. To achieve this task, we explored and compared multiple unsupervised machine learning algorithms to perform clustering. Among these algorithms, Ward clustering has the lowest running time and identified the highest number of anomalies for the upper temperature limit. The proposed approach is tested based on the data collected in a neighborhood with 46 townhomes located in Atlanta, GA.

Lebakula, Viswadeep↗

Impact of Control on Availability and Cycling of Residential HVAC in a Real-World Experiment

Demand response is an important emerging part of smart grids and there is a large stream of research from theoretical and modeling perspectives. However, there is relatively little experimental evidence that could help researchers and building operators make informed decisions on best practices for modeling, developing, and deployment of control mechanisms. We contribute to the body of experimental research by providing numerical insights into the role and availability of residential HVAC systems for control. We share the findings on the duration of the cooling cycle, off cycle, and temperature settling time of HVAC systems from data collected from a smart neighborhood located in Atlanta, GA.

cycling↗

The Empirical Effect of Fleet Optimization on Synchronization and Rebound Effects in Heat Pump Water Heaters

Demand response is a growing concept in light of the internet of things and an increasing need for grid flexibility. Water heaters are one of the preferred devices for providing demand response for grid services and peak management due to their capability to store energy. The efficient use of water heaters for demand response requires consideration of the associated load effects such as synchronization of device schedules and rebound effect. These effects present a significant challenge. Despite the importance of the mentioned effects for water heater queuing and scheduling, there has been no effort to quantify and empirically validate their impact. This study attempts to address this gap by offering two methods - Ward clustering and Euclidean K-means - to evaluate the extent of synchronization in a fleet of 42 water heaters in Atlanta, GA. Using the aforementioned methods on the measured data, we find evidence of convergence of water heater loads as a result of optimization compared to an idle period and analyzed their impact.

demand response↗

Peak Reduction Using Mode Adjustment of Heat Pump Water Heaters in a Residential Neighborhood

Building electrification is putting pressure on distribution grid worldwide. Peak reduction is an important concern that can help reduce the growing stress and allow to defer investments in new capacity. Water heaters represent a convenient way of reducing peak because they are less dependent on weather, and their storage volume allows for asynchronous water heating and hot water use. Previous empirical studies investigated the ability of water heaters to reduce peak through the adjustment of the temperature setpoint. However, not all equipment vendors offer this option. This study aims at understanding the feasibility of peak reduction with an alternative configuration available in the market - by adjusting the device mode rather than temperature setpoint. The peak reduction methodology is tested in an occupied 46-townhome neighborhood located in Atlanta, GA. We find that peak shifting is possible with the adjustable mode approach, with the change in the peak load by 30-60%.

demand response↗

Experimental Evidence on Latency in a Fleet of Controllable Water Heaters

Demand response is an important emerging part of smart grids with wide coverage in theoretical and modeling research. However, experimental evidence on the real-life behavior of controllable loads is still limited. We present observations regarding latency and communication aspects of the operation on a fleet of residential water heaters in a smart neighborhood in Atlanta, GA. Our analysis shows that latency in water heaters is not constant and does not follow a Gaussian distribution. We also find that there is a systematic relationship between latency and hour of the day. Latency was found to increase during morning and evening hours compared to the afternoon. These findings could help better plan deployment of control for demand response programs. Understanding delays associated with controlling smart devices is crucial for proper design and algorithm development for optimization, frequency of dispatch, and override detection.

communication delay↗

Using Synchronization as an Indicator of Controllability in a Fleet of Water Heaters

Peak reduction is an important concern that can help reduce the growing stress on distribution grid and allow to defer investments in new capacity. However, the growing concern for customer privacy and comfort may impact the performance of load control for residential devices. Water heaters represent a convenient way of reducing peak due to their ability to store thermal energy for future use. In this paper, we developed a methodology to help utilities gain more insight with respect to the impact of load control efforts for shaving peak with no necessary information about the water heaters except the device status (on/off). To this end, we use a fleet of water heaters in a controlled residential neighborhood in Atlanta, GA. Our findings show that convergence in device status can serve as a proxy for peak shifting during hours of the evening peak.

demand response↗

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has been deployed in occupied residential neighborhood. This system enables automatic data collection, learning, optimization, and dispatches signals to neighborhood devices. HVAC optimization is based on model predictive control (MPC). Since the operational performance of MPC depends on model forecasting accuracy, it is crucial to evaluate the model continuously and modify or retrain it as necessary. In this research, we developed an automated workflow to evaluate the performance of temperature and power forecasts based on measured data in the real world. This will provide researchers with a deeper understanding of the model and how it can be improved.

Lebakula, Viswadeep↗