SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Aspects of the present disclosure include anonymous, asynchronous, and randomized control schemes for distributed energy resources (DERs). Such control schemes may include packetized energy management (PEM) control schemes for managing DERs that may provide near-optimal tracking performance under imperfect information and consumer quality of service (QoS) constraints.
A building energy management system (BEMS) is a computer-based system designed to monitor and control a building's energy needs. Modern BEMS rely on the sensing and connectivity capabilities of Internet of Things (IoT) technology to intelligently adjust the energy consumption to reduce cost while respecting the consumers' preferences. Increasingly, control decisions are made based on predictions by models trained using supervised machine learning methods, which still requires control policies to be formulated in a rule-based fashion. When using reinforcement learning (RL) instead, control policies are learned by observing the utility in terms of cost and comfort associated with actions such as a change in the heating system's setpoint. The resulting RL-based controllers can capture not only the dynamics of the building and the associated electrical devices, but also fluctuations in electricity prices and user demand, avoiding the need to combine multiple predictive models with tailored control policies. This chapter will provide an overview of RL-based approaches for BEMS. After sketching the taxonomy of general RL methods, we discuss the implications of relying on the individual methods in a BEMS context. Existing work applying RL is presented along the key devices controlled by BEMS systems. Finally, we summarize the state-of-the-art and sketch limitations and open research directions.
Not provided.
Sensors, actuators, and controllers, which collectively serve as the backbone of cyberphysical systems for building energy management, are one of the core technical areas of investment for achieving the U.S. Department of Energy (DOE) Building Technologies Office's (BTO's) goals for energy affordability in the national building stock - both commercial and residential. In fact, an aggregated annual energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms. energy savings of 29% is estimated in the commercial sector alone through the implementation of efficiency measures using current state-of-the-art sensors and controls to retune buildings by optimizing programmable settings based on occupant schedules and comfort requirements, as well as detecting and diagnosing equipment operation and installation problems (Fernandez et al. 2017). Monitoring and control of building conditions and operations has advanced significantly, from the invention of the modern thermostat just before the start of the 20th century to the midcentury incorporation of direct digital control into devices, the introduction of open protocols and network communications at the end of the century, and finally the invention of cloud-based computing and additional advancements that have enabled remote operation and a proliferation of connected and intelligent devices in building automation. Despite this potential, however, two main challenges hinder widespread adoption of sensors and controls in building operations that can ensure savings for high-efficiency components and equipment (e.g., heat pumps, windows, and lighting devices), as well as additional savings from more sophisticated control architectures and algorithms.
Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.
Wastewater heat recovery is currently an underutilized technology that could be part of solving the climate crisis. A large portion of the heat that leaves a building in the form of wastewater is potentially recoverable for pre-heating domestic hot water or other service water systems. While there are several different approaches to wastewater heat recovery, this project focused on creating detailed, integrated building models for wastewater heat recovery heat pump systems. EnergyPlus models were developed featuring inputs and assumptions corresponding to manufacturers’ specifications, performance lab test data and feedback from engineering consultants. EnergyPlus’s supervisory control Energy Management System objects were heavily relied upon to overcome modelling challenges. The developed EnergyPlus model was integrated into U.S. Department of Energy New Construction Reference Building models for various climate zones and building types to assess potential energy use, energy cost and greenhouse gas emission reductions.
Fast-charging infrastructure for electric vehicles (EVs) is needed to enable and achieve the national goals of transitioning the vehicle fleet toward more electrification. Idaho National Laboratory, Oak Ridge National Laboratory, and the National Renewable Energy Laboratory (NREL) have jointly worked to identify, evaluate, and mitigate potential cyber-related consequences associated with fast charger systems. NREL contributed by considering cyberattack scenarios and consequences associated with integrating distributed energy resources (DERs) at fast-charging stations. The dynamic nature of fast-charger load profiles would encourage site operators to incorporate solar for energy cost reduction and energy storage for peak demand cost management at future charging facilities with multiple fast chargers at a site. These energy resources would be monitored and coordinated via a site energy management controller with data exchange between devices and local power metering infrastructure; thus, networking between devices and the design of the system becomes important in the overall cybersecurity posture. In addition, component vendors and system operators might have remote interfaces to any of these systems. It is therefore important to understand the breadth of the cyberattack surface and potential strategies to mitigate impacts. This project has focused on components and protocols expected to be found within a local charging site that includes multiple chargers and DER resources. Our methods and results are summarized in this final report.
With the growing deployment of microgrids, networked microgrids have emerged for their additional advantages of economy, reliability and resilience by coordinating the operation of multiple microgrids. As microgrids are operated with different ownership, objectives and functionalities, the formed networked microgrids show characteristics of mixed ownership, inconsistent objectives and various functionalities. To enable the coordinated operation of networked microgrids, three control structures, i.e., centralized, distributed and decentralized, have been constructed in the literature. However, the data sharing enabling these different paradigms and the resulted value propositions are not well defined, leading to poor resource management and resilience, etc. To solve this issue, a complete comparison of networked microgrid energy management under centralized, distributed and decentralized structures are performed. As a novel contribution, the required minimum data exchange of networked microgrid energy management under three control structures are identified, respectively. The value propositions are calculated and compared against each other by the results of case studies.
Systems, methods and apparatuses are provided for reducing peak energy demand and to smooth intermittent energy profiles from onsite variable energy sources and loads. Some embodiments use system level and device level analysis and optimization to adaptively adjust the operation of a behind the meter energy storage (BMES) to smooth out energy generation variabilities and follow a reference load signal, including at short time resolutions.
Residential customers use more than one-quarter of the electricity in the world. Optimally managing home energy consumption is an effective way of easing the operational challenges facing the electric grid with increasing solar photovoltaics (PV). This paper studies the impact of the future proliferation of home energy management systems (HEMS) in the presence of PV on large-scale distribution systems. First, we present a stochastic HEMS model that minimizes residential customers' thermal discomfort and energy costs under uncertainty. The HEMS model schedules the optimal operations of residential appliances in the presence of PV within a mixed-integer linear programming-based model predictive control framework that links the proposed HEMS to a quasi-steady-state time-series simulation tool. Additionally, extensive simulations are conducted for a stand-alone residential home using two tariff structures and for 1977 homes on an 8,500-node distribution feeder. Simulation results quantify the impact of the future proliferation of HEMS on the large-scale distribution system with PV.
This paper studies the performance of a model predictive control (MPC) algorithm in a home energy management system (HEMS) as the set of controllable resources varies and under both a constant and a time-of-use (TOU) electricity price structure. The set of controllable resources includes residentially-owned photovoltaic (PV) panels, a home battery system (HBS), an electric vehicle (EV), and a home heating, ventilation, and air conditioning (HVAC) system. The HEMS optimally schedules the set of controllable resources given user preferences such as indoor thermal comfort and electricity cost sensitivity. The home energy management system is built on a chance constrained, MPC-based algorithm, where the chance constraint ensures the indoor thermal comfort is satisfied with a high probability given uncertainty in the outdoor temperature and solar irradiance forecasts. Simulation results for varying sets of controllable resources under two different electricity price structures demonstrate the variation in the HEMS control with respect to HBS operation, electricity cost, and grid power usage.
This paper uses a two-level model predictive control-based approach for the coordinated control and energy management of an integrated system that includes photovoltaic (PV) generation, energy storage, and building loads. Novel features of the proposed local controller include (1) the ability to simultaneously manage building loads and energy storage to achieve different operational objectives such as energy efficiency, economic cost efficiency, demand response and grid optimization through the design of specific power trajectory tracking performance functionals, (2) an energy trim function that minimizes the impact of solar forecasting errors on system performance, and (3) the design of a state of charge controller that uses day-ahead forecast of solar power and building loads to intialize energy storage at the start of each day. The local controller is tested in simulation using an exemplary system with PV generation, energy storage and dispatchable building loads. Two sample days with different PV forecasts and multiple case scenarios are considered, and the performance of the algorithm in managing the real and reactive net building load trajectories and the ramp rate of PV injections into the utility network are evaluated. The simulations are based on actual forecasted and measured PV data, and the results show that the local controller meets the tracking requirements for real and reactive power within the operating constraints of the building.
Decarbonization of transportation systems is driving higher capacity energy storage and faster charging power requirements in electric vehicles (EVs). Given the potential advantages - such as increased efficiency, reduced inverter capacity, and less total cable mass - there is a demand in the industry for more DC distribution for high-power charging (HPC) hubs. However, the cost-effective, adaptive, and robust operation of the DC-coupled HPC hub necessitates a robust site energy management system (SEMS). Validating SEMS operation using a digital twin of an HPC hub in a real-time simulator (RTS) platform is crucial before field deployment. In this study, we propose a hybrid energy management site controller designed to achieve high-level, long-term operational objectives while managing low-level power sharing control between hub assets. We develop a centralized model predictive controller (MPC) to optimize hub operating points and use these points to update the droop parameters of the site energy storage system (ESS). This approach ensures the hub follows an optimal operating point while maintaining the flexibility to respond to load surges. We tested and verified our proposed approach both offline and on a Controller Hardware-in-the-loop (C-HIL) simulation platform integrated with a SEMS framework, demonstrating real-time site operation and validating a cost-effective and robust site controller.
With the increased adoption of distributed energy resources (DERs) in distribution networks, their coordinated control with a DER management system (DERMS) that provides grid services (e.g., voltage regulation, virtual power plant) is becoming more necessary. One particular type of DERMS using primal–dual control has recently been found to be very effective at providing multiple grid services among an aggregation of DERs; however, the main parameter, the primal–dual step size, must be manually tuned for the DERMS to be effective, which can take a considerable amount of engineering time and labor. To this end, we design a simple method that self-tunes the step size(s) and adapts it to changing system conditions. Additionally, it gives the DER management operator the ability to prioritize among possibly competing grid services. Here we evaluate the automatic tuning method on a simulation model of a real-world feeder in Colorado with data obtained from an electric utility. Through a variety of scenarios, we demonstrate that the DERMS with automatically and adaptively tuned step sizes provides higher-quality grid services than a DERMS with a manually tuned step size.
Energy management system (EMS) consists of several wide-area control applications that serve as a backbone for security, stability, and reliability of the power system. Wide-area voltage control system (WAVCS), one of the critical wide-area applications, operates in coordination with local Flexible AC Transmission System (FACTS) devices to provide voltage security and optimal management of active and reactive power resources. Since the WAVCS relies on wide-area communication and data sharing devices, possible cybersecurity vulnerabilities have to be addressed to ensure the closed-loop operation of WAVCS. In this paper, we present a methodology for performing an impact analysis of cyber-attacks in WAVCS cybersecurity. In particular, different types of data integrity attacks, such as malicious tripping, fault replay, and signal altering attacks, are considered, and detailed impact analysis is conducted in a testbed environment using the Kundur's four machine two-area system. For performing an impact analysis, the transient voltage stability of the sensitive bus voltage is studied, followed by the quantitative assessment and severity ranking using the voltage profile index. Our experimental evaluation reveals that the data integrity attacks on control signals exhibit a higher attack severity than on the measurement signals. Further, the severity of these attacks varies with nature (static or dynamic), location, and types of attacks.
Smart building technologies are a new suite of resources that improve building energy efficiency and resilience, reduce carbon emissions, and provide load flexibility to the grid. However, in both college curricula and building professionals’ continuing education, there is a lack of systematic instruction on smart building technologies–topics that include smart building concepts, key components, smart building controls, “Internet of Things” (IoT) devices, and how to integrate multiple energy systems including distributed energy resources (DER). This major gap in smart building education prevents stakeholders from understanding and adopting smart building technologies in building design and operations. Slipstream leads a DOE-funded project developing a semester-long smart building curriculum for college students and adapting the contents into 16 training videos for building professionals and the general public. The education and training cover the drivers and benefits of smart building technologies, key building energy systems, the latest sensor technologies and IoT devices, and focus on topics related to smart building controls (i.e., energy management information systems, smart building control platforms, cybersecurity, grid-interactive-efficient buildings (GEBs), smart building control methods, and occupant-centric control. This paper describes the project approach, provides outlines of the training materials, and identifies lessons learned in creating the content. We also suggest ways to scale the instruction of smart building concepts to empower the workforce to accelerate the adoption of smart building technologies in the real world.