Search NASA⌕ Search

Engineering topics

Munir, Sirajum

Publications and source records attributed to Munir, Sirajum.

HVAC control fine-grained occupancy pattern estimation

A thermal state of a plurality of zones of the building is updated according to a building thermal model and information received from temperature sensors of the building. Predicted occupant counts for an upcoming plurality of time slots for each of the plurality of zones are updated using actual occupancy counts for each of the plurality of zones. A misprediction type distribution for the upcoming plurality of time slots for each of the plurality of zones is updated, the misprediction type distribution indicating misprediction for true negatives, false positives, false negatives, and true positives. A total misprediction cost expectation is updated according to the predicted occupant counts and the misprediction type distribution. HVAC power for each of the plurality of zones is determined to optimize occupant thermal comfort weighted according to the predicted occupant counts while minimizing the total misprediction cost expectation. HVAC operation is controlled per the HVAC power.

Lin, Shan↗

Occupant thermal comfort inference using body shape information

Occupant thermal comfort may be inferred and improved using body shape information. Height, weight, and shoulder circumference of an occupant of a room may be obtained using a depth sensor. A model may be utilized that is trained on a dataset including information reflecting of occupant comfort within the room versus temperature, the model receiving, as inputs, the height, the weight, and the shoulder circumference of the occupant and environmental information and outputting a comfort class. A temperature set-point for is identified which the room occupant is identified by the model as having the comfort class being indicative of user comfort. Heating, ventilation, and air conditioning (HVAC) controls are adjusted for the room to the identified temperature set-point.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Human-in-the-loop Sensing and Control for Commercial Building Energy Efficiency and Occupant Comfort

Most of the existing heating, ventilation and air conditioning (HVAC) systems in commercial buildings operate in a conservative manner by assuming maximum occupancy in each room during pre-specified periods of the week, leading to significant energy being wasted as rooms are over-conditioned compared to the actual requirements of the occupants. Though critical, our understanding of occupancy patterns and thermal comfort needs of the occupants in commercial buildings is lacking and it is well known that both of these quantities are stochastic and time-varying, thus requiring sensing solutions to estimate them. This project had the goal of designing, implementing and evaluating a hardware and software solution to ameliorate this challenge. In particular, a depth camera (one whose pixels reveal distance from the camera as opposed to color values) placed on doorways is used to detect entrance and exit events from thermal zones in the building, and thereby estimate their occupancy levels. This information is then fed to a novel control algorithm that can, through interactions with the HVAC system, learn how to provide control inputs that maximize comfort and minimize energy waste. The resulting system represents a significant improvement over existing controllers for commercial HVAC systems and allowed us to improve our understanding of the design of future human-in-the-loop control solutions. For this solution to be feasible, the project had target metrics for its performance and cost. In particular, entrance and exit events for occupants moving about the building would need to be detected with an accuracy higher than 97%; and the resulting control inputs derived from this information would need to lead to approximately 10% energy savings compared to a schedule-based controller. Furthermore, regarding the final hardware design, the project had a target bill of materials (BOM) cost for the sensing solution of less than US$200 per unit while using less than 25W of power on average. All of these target metrics were met or exceeded by our final proposed solution. We performed evaluations by deploying the system in over 20 rooms of different types across 6 commercial buildings in Pittsburgh, PA over the course of three years, and performing targeted controlled experiments to test its performance along the different metrics. The human-in-the-loop control solutions (both hardware and software) developed through this project are expected to lead to significant improvements in the comfort and energy efficiency of HVAC systems used in commercial buildings. The insights we developed through the project pave the way to HVAC systems that can condition interior spaces according to their real-time utilization and the thermal comfort needs of the occupants, thereby reducing energy use. They also open up a new learning-based way of configuring HVAC controllers without having to manually fine-tune them for each building. These innovations can significantly increase the adoption of novel control solutions by the industry and thereby save resources and reduce costs of operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Application-driven Privacy-preserving Data Publishing with Correlated Attributes

Recent advances in computing have allowed for the possibility to collect large amounts of data on personal activities and private living spaces. To address the privacy concerns of users in this environment, we propose a novel framework called PR-GAN that offers privacy-preserving mechanism using generative adversarial networks. Given a target application, PR-GAN automatically modifies the data to hide sensitive attributes - which may be hidden and can be inferred by machine learning algorithms - while preserving the data utility in the target application. Unlike prior works, the public's possible knowledge of the correlation between the target application and sensitive attributes is built into our modeling. We formulate our problem as an optimization problem, show that an optimal solution exists and use generative adversarial networks (GAN) to create perturbations. We further show that our method provides privacy guarantees under the Pufferfish framework, an elegant generalization of the differential privacy that allows for the modeling of prior knowledge on data and correlations. Through experiments, we show that our method outperforms conventional methods in effectively hiding the sensitive attributes while guaranteeing high performance in the target application, for both property inference and training purposes. Finally, we demonstrate through further experiments that once our model learns a privacy-preserving task, such as hiding subjects' identity, on a group of individuals, it can perform the same task on a separate group with minimal performance drops.

97 MATHEMATICS AND COMPUTING↗

Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control

As occupancy sensing technologies become mature, various occupancy sensors are increasingly deployed in commercial buildings for pervasive occupancy monitoring. These sensors provide occupant-count data, which contains rich spatiotemporal information about occupancy patterns. With long-term occupant-count data collected from a commercial building, we design three different predictive models that capture the occupancy dynamics and examine how a model predictive control of the HVAC system benefits from actual occupancy count prediction. Our analysis reveals that mispredictions of occupancy states, especially false positives and false negatives, may introduce inefficient control that leads to energy waste or user discomfort. To address this issue, we take a step further to design an adaptive model predictive controller that minimizes inefficient control actions according to misprediction types and distributions. A comprehensive evaluation is performed in OpenBuild and EnergyPlus simulators to study the effectiveness of the proposed end-to-end control strategy. The evaluation shows that the proposed solution reduces energy consumption by 29.5% while improving the average weighted occupants comfort by 86.7% in Predicted Mean Vote (PMV) over the fixed schedule strategy.

97 MATHEMATICS AND COMPUTING↗

OccuTherm: Occupant Thermal Comfort Inference using Body Shape Information

Thermal comfort is a decisive factor for the well-being, productivity, and overall satisfaction of commercial building occupants. Many commercial building automation systems either use a fixed zone-wide temperature set-point for all occupants or they rely on extensive sensor deployments with frequent online interaction with occupants. This results in inadequate comfort levels or significant training effort from users, respectively. However, the increasing ubiquity of cheap, depth-based occupancy tracking systems has enabled an improvement in inferential capabilities. We propose the novel system OccuTherm to model thermal comfort of occupants. We conducted a laboratory study with 77 participants to collect data for the implementation of a thermal comfort model that derives thermal comfort using the human body shape. Based on the comparison with model baselines and ablations, we show that our approach infers thermal comfort of individuals with 60 % accuracy when body shape information is taken into account; 6 % more than state-of-the-art approaches. We make our code, mobile app, datasets, and models freely available.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

OccuTherm: Occupant Thermal Comfort Inference using Body Shape Information

This repository contains the official data from a USDOE-funded project at Carnegie Mellon University and Bosch Research Pittsburgh. The primary goal of the project was to investigate the relationship between indoor commercial building occupant thermal comfort and various biometric and environmental predictors. We performed 77 individual comfort experiments, approved by our Institutional Review Board (IRB) and in satisfaction of participant consent guidelines. Our goal was to generate a dataset than enables comprehensive study of human thermal comfort preferences, in a commercial building environment, across a wide range of indoor environmental conditions. The data is comprised of the following feature groups: depth camera frames, biometrics sensor data, body shape information, subjective comfort data from the mobile device application, environmental sensor data from the commercial building HVAC system, and outdoor weather station data.

47 OTHER INSTRUMENTATION↗

Dataset: Inferring Thermal Comfort using Body Shape Information Utilizing Depth Sensors

Thermal comfort is very important for well-being and productivity of building occupants. It has been shown that body shape is a useful feature to determine thermal comfort of individuals [2]. It is because, the heat dissipation rate of individuals depends on the body surface area. As a result, a tall and skinny person can tolerate higher room temperature than a rounded body shape person [5]. In order to test this hypothesis, we performed a year-long experiment in 2017, where we recruited 77 participants and put each of them in a thermally controlled conference room in CMU for 3 hours and recorded their subjective responses regarding thermal comfort at different temperature ranging from 60°F to 80°F. In addition, we collected depth data of individuals using a vertically mounted Microsoft Kinect for XBOX One at the entrance of the conference room to capture their body shape. We also collected biometric features (e.g., Galvanic Skin Response (GSR), skin temperature) using a Microsoft Health Band worn by the subjects. The resulting dataset provides rich information regarding how different features can be used to infer thermal comfort of the individuals.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dataset: Occupancy Detection, Tracking, and Estimation Using a Vertically Mounted Depth Sensor

Occupancy detection, tracking, and estimation has a wide range of applications including improving building energy efficiency, safety, and security of the occupants. As depth sensors are getting cheaper, they offer a viable solution to estimate occupancy accurately in a non-privacy invasive manner. Even though there are publicly available depth datasets, they do not consider placing the sensor in the ceiling looking downwards to estimate occupancy. We deployed four Kinect for XBOX One in four CMU classrooms and conference rooms for a period of four weeks in 2017 and collected over 6 TB of depth data. We annotate this huge dataset by labelling bounding boxes around occupants and release the annotated dataset.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dataset: Occupancy Detection, Tracking, and Estimation Using a Vertically Mounted Depth Sensor

Occupancy detection, tracking, and estimation has a wide range of applications including improving building energy efficiency, safety, and security of the occupants. As depth sensors are getting cheaper, they offer a viable solution to estimate occupancy accurately in a non-privacy invasive manner. Even though there are publicly available depth datasets, they do not consider placing the sensor in the ceiling looking downwards to estimate occupancy. We deployed four Kinect for XBOX One in four CMU classrooms and conference rooms for a period of four weeks in 2017 and collected over 6 TB of depth data. We annotate this huge dataset by labelling bounding boxes around occupants and release the annotated dataset.

47 OTHER INSTRUMENTATION↗

Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information

Understanding the models that characterize the thermal dynamics in a smart building is important for the comfort of its occupants and for its energy optimization. Here, a significant amount of research has attempted to utilize thermodynamics (physical) models for smart building control, but these approaches remain challenging due to the stochastic nature of the intermittent environmental disturbances. This paper presents a novel data-driven approach for indoor thermal model inference, which combines an Autoregressive Moving Average with eXogenous inputs model (ARMAX) with a Normalized Mutual Information scheme (NMI). Based on this information-theoretic method, NMI, causal dependencies between the indoor temperature and exogenous inputs are explicitly obtained as a guideline for the ARMAX model to find the dominating inputs. For validation, we use three datasets based on building energy systems-against which we compare our method to an autoregressive model with exogenous inputs (ARX), a regularized ARMAX model, and state-space models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ODDS: Real-Time Object Detection Using Depth Sensors on Embedded GPUs

Detecting objects that are carried when someone enters or exits a room is very useful for a wide range of smart building applications including safety, security, and energy efficiency. While there has been a significant amount of work on object recognition using large-scale RGB image datasets, RGB cameras are too privacy invasive in many smart building applications and they work poorly in the dark. Additionally, deep object detection networks require powerful and expensive GPUs. We propose a novel system that we call ODDS (Object Detector using a Depth Sensor) that can detect objects in real-time using only raw depth data on an embedded GPU, e.g., NVIDIA Jetson TX1. Hence, our solution is significantly less privacy invasive (even if the sensor is compromised) and less expensive, while maintaining a comparable accuracy with state of the art solutions. Specifically, we resort to training a deep convolutional neural network using raw depth images, with curriculum based learning to improve accuracy by considering the complexity and imbalance in object classes and developing a sparse coding based technique that speeds up the system ~2× with minimal loss of accuracy. Based on a complete implementation and real-world evaluation, we see ODDS achieve 80.14% mean average precision in object detection in real-time (5-6 FPS) on a Jetson TX1.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Understanding Occupancy Patterns in a Commercial Space

Heating, ventilation, and air conditioning (HVAC) is a prime source of energy consumption in the US. In 2006, approximately 35% of energy in the US was used for HVAC [1]. Usually building operators use a static schedule for controlling HVAC systems without having a deeper understanding of how many people use the building at different times of the day. In addition, HVAC systems operate by assuming maximum occupancy in each room, which leads to a significant energy waste, e.g., an HVAC system providing ventilation for 30 people when there are only 10 people in a room. Considering how many people use different rooms at different times of the day is very crucial for achieving building energy efficiency and providing occupant comfort. There have been several attempts to collect long term occupancy patterns from office buildings, e.g., Mitsubishi’s Electronic Research Lab (MERL) dataset [14] and Colorado School of Mines (CSMBB) dataset. However, PIR motion detectors are used in these projects for sensing occupancy and hence these datasets only reflect whether a room is occupied or not without revealing the actual person count. Similar datasets are also collected from households. Only a few datasets from commercial spaces capture actual person count, and even in these cases, the data collection period was very limited, e.g., in [3] only 5 days of occupancy data is collected as ground truth. We are the first to collect long term (9 months) occupancy data (people count) from an 11,000 square foot commercial office (second floor of Bosch Research and Technology Center Pittsburgh). In this paper, we outline some statistical results from our empirical study and explore their implications for saving energy.

42 ENGINEERING↗

FORK: fine grained occupancy estimatoR using kinect on ARM embedded platforms

Occupancy estimation is very useful for a wide range of smart building applications including energy efficiency, safety, and security. In this demonstration, we present a novel solution called FORK, which uses a Kinect depth sensor for estimating occupancy in real-time. Unlike other camera-based solutions, FORK is much less privacy invasive (even if the sensor is compromised) and it does not require a powerful machine like a Microsoft XBOX or an Intel® Core™ i7 processor to process the depth data. Our system performs the entire depth data processing on a cheaper and lower-power ARM processor, in real-time. In order to do that, FORK uses a novel lightweight human model by leveraging anthropometric properties of human bodies for detecting individuals. We will show how FORK detects, tracks, and counts occupants accurately in real-time.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Real-Time Fine Grained Occupancy Estimation Using Depth Sensors on ARM Embedded Platforms

Occupancy estimation is an important primitive for a wide range of applications including building energy efficiency, safety, and security. In this paper, we explore the potential of using depth sensors to detect, estimate, identify, and track occupants in buildings. While depth sensors have been widely used for human detection and gesture recognition, computer vision algorithms are typically run on a powerful computer like XBOX or Intel R CoreTM i7 processor. In this work, we develop a prototype system called FORK using off-the-shelf components that performs the entire depth data processing on a cheaper and low power ARM processor in real-time. As ARM processors are extremely weak in running computer vision algorithms, FORK is designed to detect humans and track them in a very efficient way by leveraging a novel lightweight model based approach instead of traditional approaches based on histogram of oriented gradients (HOG) features. Unlike other camera based approaches, FORK is much less privacy invasive (even if the sensor is compromised). Based on a complete implementation, real-world deployment, and extensive evaluation at realistic scenarios, we observe that FORK achieves over 99% accuracy in real-time (4-9 FPS) in occupancy estimation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Long term occupancy estimation in a commercial space: an empirical study: poster abstract

Understanding occupancy patterns in a building is very useful to control HVAC systems for improving energy efficiency of the building and occupant comfort. There has been a very little attempt to understand long term occupancy patterns in a commercial space. In this work, we leverage depth sensors (Kinect for XBOX One) to collect occupancy count from an 11,000 square foot commercial space (Bosch office) for nine months. We analyze the collected data and describe key findings that provide deep insights about how a commercial space is used and serve as a guideline to formulate novel and efficient control strategies.

Liu, Kin Sum↗