Search NASA⌕ Search

Engineering topics

Park, June Young

Publications and source records attributed to Park, June Young.

Ten questions concerning reinforcement learning for building energy management

As buildings account for approximately 40% of global energy consumption and associated greenhouse gas emissions, their role in decarbonizing the power grid is crucial. The increased integration of variable energy sources, such as renewables, introduces uncertainties and unprecedented flexibilities, necessitating buildings to adapt their energy demand to enhance grid resiliency. Consequently, buildings must transition from passive energy consumers to active grid assets, providing demand flexibility and energy elasticity while maintaining occupant comfort and health. This fundamental shift demands advanced optimal control methods to manage escalating energy demand and avert power outages. Reinforcement learning (RL) emerges as a promising method to address these challenges. Here, in this paper, we explore ten questions related to the application of RL in buildings, specifically targeting flexible energy management. We consider the growing availability of data, advancements in machine learning algorithms, open-source tools, and the practical deployment aspects associated with software and hardware requirements. Our objective is to deliver a comprehensive introduction to RL, present an overview of existing research and accomplishments, underscore the challenges and opportunities, and propose potential future research directions to expedite the adoption of RL for building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Ten questions concerning occupant-centric control and operations

Occupant-Centric Control and Operation (OCC) represents a transformative approach to building management, integrating sensing of indoor environmental quality, occupant presence, and occupant-building interactions. These data are then utilized to optimize both operational efficiency and occupant comfort. This paper summarizes the findings from the IEA-EBC Annex 79 research program's subtask on real world implementations of OCC during the past 5 years. First, in Q1 and Q2, we provide a definition and categorization of OCC. Q3 addresses the role of building operators for OCC, while Q4 describes the implications for designers. Then, Q5 and Q6 discuss the role and possibilities of OCC for load flexibility, and for pandemic induced paradigm shifts in the built environment, respectively. In Q7, we provide a taxonomy and selection process of OCC, while Q8 details real world implementation case studies. Finally, Q9 explains the limits of OCC, and Q10 provides a vision for future research opportunities. Furthermore, our findings offer valuable insights for researchers, practitioners, and policy makers, contributing to the ongoing discourse on the future of building operations management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Global Building Occupant Behavior Database

This paper introduces a database of 34 field-measured building occupant behavior datasets collected from 15 countries and 39 institutions across 10 climatic zones covering various building types in both commercial and residential sectors. This is a comprehensive global database about building occupant behavior. The database includes occupancy patterns (i.e., presence and people count) and occupant behaviors (i.e., interactions with devices, equipment, and technical systems in buildings). Brick schema models were developed to represent sensor and room metadata information. The database is publicly available, and a website was created for the public to access, query, and download specific datasets or the whole database interactively. The database can help to advance the knowledge and understanding of realistic occupancy patterns and human-building interactions with building systems (e.g., light switching, set-point changes on thermostats, fans on/off, etc.) and envelopes (e.g., window opening/closing). With these more realistic inputs of occupants’ schedules and their interactions with buildings and systems, building designers, energy modelers, and consultants can improve the accuracy of building energy simulation and building load forecasting.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The ASHRAE Great Energy Predictor III competition: Overview and results

In late 2019, ASHRAE hosted the Great Energy Predictor III (GEPIII) machine learning competition on the Kaggle platform. This launch marked the third energy prediction competition from ASHRAE and the first since the mid-1990s. In this updated version, the competitors were provided with over 20 million points of training data from 2,380 energy meters collected for 1,448 buildings from 16 sources. This competition’s overall objective was to find the most accurate modeling solutions for the prediction of over 41 million private and public test data points. Furthermore, the competition had 4,370 participants, split across 3,614 teams from 94 countries who submitted 39,403 predictions. In addition to the top five winning workflows, the competitors publicly shared 415 reproducible online machine learning workflow examples (notebooks), including over 40 additional, full solutions. This paper gives a high-level overview of the competition preparation and dataset, competitors and their discussions, machine learning workflows and models generated, winners and their submissions, discussion of lessons learned, and competition outputs and next steps. The most popular and accurate machine learning workflows used large ensembles of mostly gradient boosting tree models, such as LightGBM. Similar to the first predictor competition, preprocessing of the data sets emerged as a key differentiator.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An international review of occupant-related aspects of building energy codes and standards

In light of recent research, it is evident that occupants are playing an increasingly important role in building energy performance. Furthermore, despite the important role of building energy codes and standards in design, the occupant-related aspects are typically simple and have not kept up with the leading research. This paper reviews 23 regions’ building energy codes and standards by first comparing their quantitative aspects and then analyzing their mandated rules and approaches. While the present paper focuses on offices, general recommendations are applicable to other building types as well. The review revealed a wide range of occupant-related values, approaches, and attitudes. For example, code-specified occupant density varies by nearly a factor of three between different codes. This underlines the need for development of advancement in occupant behavior modeling approaches for future occupant-centric building performance codes and standards. Moreover, occupants are often referred to only implicitly; underlying expectations about energy-saving occupant behavior from building occupants varies greatly; and, only a few codes address occupant feedback and system usability. Based on the findings of the review, a set of initial recommendations for future building energy codes is proposed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Poster Abstract: Investigating Occupancy Profiles Using Convolutional Neural Networks: Preprint

In this paper, we implement a convolutional neural networks based autoencoder to investigate occupancy profiles. We use the American time use survey data, which contains 191,558 schedules with binary occupancy information. Our results suggest that the trained filters provide an important insight of occupancy profiles (i.e., dominant and distinct patterns), and the latent space compresses the profiles with representative information.

14 SOLAR ENERGY↗

The good, the bad, and the ugly: Data-driven load profile discord identification in a large building portfolio

Reducing the overall energy consumption and associated greenhouse gas emissions in the building sector is essential for meeting our future sustainability goals. Recently, smart energy metering facilities have been deployed to enable monitoring of energy consumption data with hourly or subhourly temporal resolution. This unprecedented data collection has created various opportunities for advanced data analytics involving load profiles (e.g., building energy benchmarking programs, building-to-grid integration, and calibration of urban-scale energy models). These applications often need preprocessing steps to detect daily load profile discords, such as: 1) outliers due to system malfunctions (the bad) and 2) irregular energy consumption patterns, such as those resulting from holidays (the ugly) compared to normal consumption patterns (the good). However, current preprocessing methods predominantly focus on filtering using statistical threshold values, which fail to capture the contextual discords of daily profiles. In addition, discord detection algorithms in building research are often aimed at finding individual building-level discords, which are not suitable at a large scale. Thus, here, we develop a method for automated load profile discord identification (ALDI) in a large portfolio of buildings (more than 100 buildings). Specifically, ALDI 1) uses the matrix profile (MP) method to quantify the similarities of daily subsequences in time series meter data, 2) compares daily MP values with typical-day MP distributions using the Kolmogorov-Smirnov test, and 3) identifies daily load profile discords in a large building portfolio. We evaluate ALDI using the metering data of both an academic campus and a residential neighborhood. Our results demonstrate that ALDI efficiently discovers measurement errors by system malfunctions and low energy consumption days in the academic campus portfolio, and it detects unique load shape patterns likely driven by occupant behavior and extreme weather conditions in the residential neighborhood.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗