Search NASA⌕ Search

Engineering topics

Helsen, Lieve

Publications and source records attributed to Helsen, Lieve.

Ten questions concerning reinforcement learning for building energy management

As buildings account for approximately 40% of global energy consumption and associated greenhouse gas emissions, their role in decarbonizing the power grid is crucial. The increased integration of variable energy sources, such as renewables, introduces uncertainties and unprecedented flexibilities, necessitating buildings to adapt their energy demand to enhance grid resiliency. Consequently, buildings must transition from passive energy consumers to active grid assets, providing demand flexibility and energy elasticity while maintaining occupant comfort and health. This fundamental shift demands advanced optimal control methods to manage escalating energy demand and avert power outages. Reinforcement learning (RL) emerges as a promising method to address these challenges. Here, in this paper, we explore ten questions related to the application of RL in buildings, specifically targeting flexible energy management. We consider the growing availability of data, advancements in machine learning algorithms, open-source tools, and the practical deployment aspects associated with software and hardware requirements. Our objective is to deliver a comprehensive introduction to RL, present an overview of existing research and accomplishments, underscore the challenges and opportunities, and propose potential future research directions to expedite the adoption of RL for building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Fluid temperature predictions of geothermal borefields using load estimations via state observers

Fluid temperature predictions of geothermal borefields usually involves temporal superposition of its characteristic g-function, using load aggregation schemes to reduce computational times. Assuming that the ground has linear properties, it can be modeled as a linear state space system where the states are the aggregated loads. However, the application and accuracy of these models is compromised when the borefield is already operating and its load history is not registered or there are gaps in the data. This paper assesses the performance of state observers to estimate the borefield load history and obtain accurate fluid predictions. Results show that both Time-Varying Kalman Filter (TVKF) and Moving Horizon Estimator (MHE) provide predictions with average and maximum errors below 0.1 $^\circ C$ and 1 $^\circ C$ respectively. MHE outperforms TVKF in terms of n-step ahead output predictions and load history profile at the expenses of about 5 times more computational time.

Figueroa, Iago C.↗

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗

Cloud-based implementation of white-box model predictive control for a GEOTABS office building: A field test demonstration

Model predictive control (MPC) has been proven in simulations and pilot case studies to be a superior control strategy for large buildings. MPC can utilize the weather and occupancy schedule forecasts, together with the system model, to predict the future thermal behavior of the building and minimize the overall energy use and maximize thermal comfort. However, these advantages come with the cost of increased modeling effort, computational demands, communication infrastructure, and commissioning efforts. Thus a typical approach is to, often rapidly, simplify the building modeling and MPC optimization problem while paying a price of not reaching the full performance potential. It has been shown that by employing accurate physics-based models, MPC performance can be notably increased closer to its theoretical performance bound. However, implementation of such high-fidelity MPC in real buildings remains a challenge, resulting in a lack of successful field test studies. This work presents the methodology and field test demonstration of a computationally efficient implementation of the white-box MPC in an office building in Belgium. The detailed model of the building is based on first-principle physical equations. The deployment and supervision of MPC operation in a practical setting are supported by an automated cloud-based communication infrastructure. The motivating factor behind the cloud-based architecture is its compatibility with a commercially appealing control as a service concept. The building is equipped with a ground source heat pump (GSHP) and thermally activated building structures (TABS), where the combination of both is also known as GEOTABS. From a control perspective, GEOTABS buildings are particularly challenging systems due to large scale, complex heating, ventilation and air conditioning (HVAC) system, and slow dynamics with time delays. On the other hand, there is an increased potential for energy savings due to the high thermal mass, which acts as thermal storage. The MPC operation is demonstrated during the challenging transient seasons (switching between heating and cooling), and its performance is compared to a traditional rule-based controller (RBC). We provide a proof of concept of real MPC operation for the most difficult seasons with notable GSHP energy use savings equal to 53.5% and thermal comfort improvement by 36.9%. Other MPC applications found in the literature describe tests for only cooling or only heating, and up to now only for a black-box or a grey-box approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Stripping off the implementation complexity of physics-based model predictive control for buildings via deep learning

Over the past decade, model predictive control (MPC) has been considered as the most promising solution for intelligent building operation. Despite extensive effort, transfer of this technology into practice is hampered by the need to obtain an accurate controller model with minimum effort, the need of expert knowledge to set it up, and the need of increased computational power and dedicated software to run it. A promising direction that tackles the last two problems was proposed by approximate explicit MPC where the optimal control policies are learned from MPC data via a suitable function approximator, e.g., a deep learning (DL) model. The main advantage of the proposed approach stems from simple evaluation at execution time leading to low computational footprints and easy deployment on embedded HW platforms. We present the energy savings potential of physics-based (also called 'white-box') MPC applied to an office building in Belgium. Moreover, we demonstrate how deep learning approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the major challenges and remaining open-research questions.

Drgona, Jan↗

Prototyping the BOPTEST Framework for Simulation-Based Testing of Advanced Control Strategies in Buildings

Advanced control strategies are becoming increasingly necessary in buildings in order to meet and balance requirements for energy efficiency, demand flexibility, and occupant comfort. Additional development and widespread adoption of emerging control strategies, however, ultimately require low implementation costs to reduce payback period and verified performance to gain control vendor, building owner, and operator trust. This is difficult in an already first-cost driven and risk-averse industry. Recent innovations in building simulation can significantly aid in meeting these requirements and spurring innovation at early stages of development by evaluating performance, comparing state-of-the-art to new strategies, providing installation experience, and testing controller implementations. This paper presents the development of a simulation framework consisting of test cases and software platform for the testing of advanced control strategies (BOPTEST - Building Optimization Performance Test). The objectives and requirements of the framework, components of a test case, and proposed software platform architecture are described, and the framework is demonstrated with a prototype implementation and example test case.

Blum, David↗

Ten questions concerning integrating smart buildings into the smart grid

Recent advances in information and communications technology (ICT) have initiated development of a smart electrical grid and smart buildings. Buildings consume a large portion of the total electricity production worldwide, and to fully develop a smart grid they must be integrated with that grid. Buildings can now be 'prosumers' on the grid (both producers and consumers), and the continued growth of distributed renewable energy generation is raising new challenges in terms of grid stability over various time scales. Buildings can contribute to grid stability by managing their overall electrical demand in response to current conditions. Facility managers must balance demand response requests by grid operators with energy needed to maintain smooth building operations. For example, maintaining thermal comfort within an occupied building requires energy and, thus an optimized solution balancing energy use with indoor environmental quality (adequate thermal comfort, lighting, etc.) is needed. Successful integration of buildings and their systems with the grid also requires interoperable data exchange. However, the adoption and integration of newer control and communication technologies into buildings can be problematic with older legacy HVAC and building control systems. Public policy and economic structures have not kept up with the technical developments that have given rise to the budding smart grid, and further developments are needed in both technical and non-technical areas.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Simulation Speed Analysis and Improvements of Modelica Models for Building Energy Simulation

This paper presents an approach for speeding up Modelica models. Insight is provided into how Modelica models are solved and what determines the tool’s computational speed. Aspects such as algebraic loops, code efficiency and integrator choice are discussed. This is illustrated using simple building simulation examples and Dymola. The generality of the work is in some cases verified using OpenModelica. Using this approach, a medium sized office building including building envelope, heating ventilation and air conditioning (HVAC) systems and control strategy can be simulated at a speed five hundred times faster than real time.

Jorissen, Filip↗