SEARCH · Search NASA

Results for “residential demand flexibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Enhancing heat pump water heater performance with embedded phase change materials thermal energy storage: First hour rating improvement and demand response operation

The increasing global emphasis on energy efficiency and sustainability has put heat pump water heaters (HPWHs) in the spotlight as an energy-efficient alternative to traditional water heating systems. However, their widespread adoption is limited by challenges such as insufficient First Hour Rating (FHR), suboptimal control mechanisms, and limited flexibility for demand response operations. Here, to address these limitations, this study proposes an innovative HPWH system integrated with embedded phase change material (PCM)-based thermal energy storage (TES). The research introduces a novel design and control strategy that leverages optimized PCM integration to enhance thermal storage capacity, improve hot water delivery during peak demand, and increase load-shifting potential. A combination of system modeling, performance simulation, and demand response control strategy evaluation was employed to quantify the benefits of PCM integration. Results demonstrate that the proposed PCM-TES HPWH system significantly enhances FHR, with an optimal 7.0 lb. of PCM increasing FHR by over 26 %—from 62 to 78 gal—for a standard 50-gal HPWH. Additionally, under advanced demand response operation using a preheat strategy, the system reduces the percentage of control temperature out-of-band time from 65 % (conventional HPWH) to just 11.6 %, enabling a more stable and efficient hot water supply. This research contributes a novel PCM-embedded HPWH design and control framework that addresses both performance and grid-interactivity challenges. The findings offer a viable pathway to enhancing the operational efficiency, flexibility, and grid responsiveness of residential water heating systems.

Demand response control↗

DOE OSTI2023

Enhancing flexibility for climate change using seasonal energy storage (aquifer thermal energy storage) in distributed energy systems

Long-term energy storage is expected to play a vital role in the deep decarbonization of building energy sectors, while enhancing the flexibility of buildings to withstand future climate variations. However, it is challenging to design distributed multi-energy systems (DMES) while taking into account the uncertainties introduced by climate change, since stochastic optimization of such systems is difficult. The present study introduces a stochastic optimization model to address this bottleneck, taking into account DMES including aquifer thermal energy storage (ATES) as the long-term thermal storage. For the first time, a novel optimization algorithm links ATES with the DMES optimization model with the support of a simplified geotechnical model. Subsequently, a case study was conducted, focusing on a residential district in Chicago where the impact of future climate condition, energy demand, and solar and wind energy potentials were evaluated using Weather Research and Forecasting (WRF) data (up to 2080) and the EnergyPlus model. The study revealed that ATES is an attractive way to improve the renewable energy penetration level and minimize the dependence on fossil fuels with reasonable support from the grid to assist the fluctuations in both demand and generation. Furthermore, ATES notably reduces fuel consumption and dependence while greatly enhancing the flexibility of the energy system to withstand fluctuations in demand and renewable energy generation brought by future climate variations. These qualities will make ATES an important part of distributed energy systems, even though it is not currently the lowest cost alternative due to lack of technology maturity. Furthermore, the design platform introduced in the present study can be used to design DMES enhancing flexibility to accommodate future climate variations.

25 ENERGY STORAGE↗

DOE OSTI2021

A Study of Cost-Saving Potential of Load Flexibility Measures in Grid-Interactive Multifamily Buildings

With recent advances in smart technologies, more and more smart devices are penetrating the residential and commercial buildings market. The introduction of these smart devices is also helping IoT companies emerge with load aggregator roles in the sector. With more utility companies on the track of supporting OpenADR protocols, the aggregators could play a significant role in providing load flexibilities by automatically responding to demand response (DR) events and coordinating load flexibility measures between customers. This would benefit utility companies by reducing stress on the grid during critical peak demand hours as well as customers by allowing them to utilize utility rate structures advantageous to those able to reduce electric usage during high-demand hours. This study evaluates cost and energy savings from adopting multiple load flexibility measures in multifamily buildings. Combinations of different load flexibility measures, including space temperature floating, light dimming, automatic window shading, and water heater temperature floating, are considered. The simulations are performed using OpenStudio®, an open-source U.S. Department of Energy (DOE) simulation platform. For the case study, we used a midrise apartment building with weather conditions from Denver, Colorado. To compare climate zone differences, simulations were also performed for Los Angeles, California, and Chicago, Illinois. Initial results indicate that the application of automated load flexibility measures without careful consideration of dispatching strategies and DR program enrollments could significantly affect the savings. To get meaningful cost savings, aggregators need to encourage tenant awareness to curtail energy usage through occupant behavior in addition to dispatching automatic load flexibility measures. The outcomes from this study are believed to help load aggregators understand the risks and benefits of load flexibility opportunities.

building energy modeling↗

DOE OSTI2026

Calibration of urban building energy model using smart meter data for district peak load prediction

Urban building energy modeling (UBEM) is a powerful approach to assessing baseline building energy performance and retrofits with new technologies across building stocks in cities. However, the accuracy of UBEM is often constrained by the limited availability of reliable data about building characteristics and operations, such as envelope efficiency levels, HVAC system performance, and end-use load patterns. Existing research has performed UBEM calibration using annual or monthly energy consumption data, which falls short when higher-resolution time series applications are needed, such as peak load prediction for utility operation planning. This study presents a new framework for calibrating building energy models at urban scale using smart meter data, targeting the accurate prediction of summer peak electricity loads to support robust grid planning. The framework first integrates various data sources to enhance baseline input assumptions for building models, and then calibrates the baseline models through a pattern-matching approach. A case study using CityBES and two years of AMI data from over 9000 residential customers in Portland, Oregon, demonstrated the workflow and its effectiveness. The calibrated models achieved a daily peak load mean absolute percentage error of 2.6 % during the heatwave in the calibration year, and 2.0 % in the validation year using another year of AMI data. Using the calibrated models, we analyzed the demand flexibility potential of the district building stock as an application of UBEM calibration. The findings affirm the appropriate use of UBEM for peak electric load forecasting and demand side management at the utility distribution system level.

AMI data↗

DOE OSTI2024

Optimal Managed Fast-Charging Model for Electric Vehicle Fleets with High Utilization and Multiple Charge-Acceptance Curves

A predictive control/scheduling optimization model is proposed for managed charging of an electric vehicle (EV) fleet - under time-of-use energy and demand prices, high vehicle utilization frequency (short dwell times), multiple charge- acceptance curves (configurable charging rates), and flexible vehicle demand. This context is particularly relevant for flight schools (small electric aircraft) or other commercial facilities where an EV fleet performs multiple operating and fast-charging sessions on the same day. The proposed model performs both the operational and charging scheduling of the vehicles, which is not typically done for residential managed charging and significantly increases problem complexity. The problem is formulated as a MILP model and a case study of a small fast-charging station is presented. Results demonstrate a significant reduction in operating cost, mainly from peak shaving during high demand price periods, achieved by coordinating the operation of different vehicles, chargers and charging rates.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

DOE OSTI2022

Methods for Computing Physically Realistic Estimates of Electric Water Heater Demand Response Resource Suitable for Bulk Power System Planning Models

Demand response is commonly called on to reduce load during system peak times or to respond to contingency events. In future power systems with higher shares of wind and solar generation (which we describe together as variable generation [VG]), demand response could have more opportunities to provide energy shifting or operating reserve services. This report evaluates the ability of residential electric water heaters, both electric resistance water heaters (ERWHs) and heat pump water heaters (HPWHs), to provide such services starting from detailed whole-building energy models that realistically represent New England single family home stock. We use a parsimonious surrogate model to represent operational flexibility in a form suitable for linear and mixed integer programming. This enables relatively fast determination of aggregate contingency reserve resource, price-taking energy shifting outcomes, and in some cases the determination of aggregate models at the megawatt (MW) scale that can be directly included in large-scale grid models. After selecting modeling methods and parameters through various computational experiments, we find interquartile ranges of contingency reserve resource in ISO-NE for about 603,400 ERWHs of 45 MW - 69 MW for Claim10 (50 minute responses provided with 10 minutes of advanced notification) and 65 MW - 102 MW for Claim30 (30 minute responses provided with 30 minutes of advanced notification), and for about 619,000 HPWHs of 48 MW - 88 MW for Claim10 and 52 MW - 90 MW for Claim30. The overall reserve resource is up to 32% of total load for ERWHs providing Claim10 service, 47% for ERWHs providing Claim30 service, 93% for HPWHs providing Claim10 service, and 97% for HPWHs providing Claim30 service. More work is required to determine if HPWHs are inherently more suitable than ERWHs for providing contingency reserve or if these results reflect idiosyncrasies of the single family home stock model used in this study. The value of this contingency resource in a Near-term VG model of ISO-NE is $\$ 0.40$ to $\$1.20$ per water heater-year, and significantly larger, $\$ 3.80$ to $\$ 5.30$ per water heater-year in a Mid-term VG model of ISONE. Aggregating surrogate models to the MW-scale for energy shifting service is more challenging than for contingency service and we only present such results for ERWHs, because we were unable to determine satisfactory ways to deal with HPWHs' time-varying and path dependent operational characteristics. Individual surrogate models suitable for evaluating the energy shifting resource from both ERWHs and HPWHs are created, however, and dispatched against day-ahead prices from the Near-Term VG and Mid-Term VG models of ISO-NE. The individual surrogate models are able to access and potentially shift all 640 GWh of HPWH load and 1,547 GWh of ERWH load we modeled in two different single family home stock models. In contrast, the most effective model of aggregate ERWH shifting resource we created only captured 34.7% of the total ERWH load. Energy shifting affected by price-taking dispatch against modeled day-ahead energy prices produces per water heater year profits of $\$19.44$ - $\$22.93$ for individual HPWHs, $\$39.11$ - $\$40.54$ for individual ERWHs, and up to $\$4.00$ - $\$4.24$ for aggregated ERWHs, with the variations mainly due to grid conditions (more or less VG). When the supply-side response to these changes is accounted for, the per water heater year production cost savings for ISO-NE are $\$7.50$ to $\$17.70$ for the most effective set of endogenously dispatched aggregate ERWHs, $\$15.60$ to $\$15.70$ for individual ERWHs dispatched against the DA prices, and $\$10.70$ to $\$11.20$ for individual HPWHs dispatched against DA prices. Those ranges primarily represent the difference between Near-Term VG and Mid-Term VG grid conditions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

Progressing Analysis of Variable Electric Rates (PAVER) Study

The Progressing Analysis of Variable Electric Rates (PAVER) study analyzed the impact of a range of time-varying electric rates on the performance of a regional electric grid and the resulting costs for participating and non-participating customers. This analysis leveraged and extended the work of PNNL’s Distribution System Operator with Transactive (DSO+T) study. Five different rate designs were included: a flat volumetric energy charge, a typical Time of Use (TOU) rate, a dynamic energy (DE) rate (based on wholesale locational marginal prices), a dynamic energy and capacity (DE+C) rate, and, finally, a Block and Swing (B&S) rate that billed customers based on their average load profile at constant pricing, but used the DE+C dynamic price for load deviations from their average profile. These rates were analyzed in a large-scale co-simulation of an entire regional grid with a customer population representative of the current state. A large fraction (80%) of residential and commercial customers were assumed to participate in these time-varying rates with automatically controlled HVAC, water heaters, electric vehicles, and batteries. This study assumed no industrial sector participation. The DE and DE+C rates saw system peak loads reduced by 6-7%, while the large participation in the TOU rate case saw a significant rebound effect and a resulting peak load increase of >5%. The impacts to the annual and peak system demand impacted system wholesale prices and the overall grid operating costs. This cost structure determined the revenue needed to be collected from customers by each rate design. Participating customers on the DE and DE+C rates (located in one of the modeled DSOs) saw reductions in average annual electricity bills of 11-17% with average increases in monthly bill variation of no more than 13%. At such high participation levels, TOU customers saw 10% higher average annual bills (due to system-wide rebound effects) and average increased monthly bill variation of 16%. Residential owners of large flexible loads (such as electric vehicles) saw larger bill savings (17-20%) when on a fully dynamic rate. The presence of on-site generation (such as rooftop solar) did not appear to appreciably change customer outcomes. Customers on the Block and Swing rate did see 6% lower monthly bill variation (as intended) than the flat rate case, but at the expense of appreciable bill savings, which were only 3%, comparable to the savings seen by non-participants. Given this finding we recommend that additional research be conducted into how best various bill protection mechanisms can balance minimizing customer bill variation with providing financial incentives commensurate with the flexibility customers provide. We also recommend that customer outcomes be explored across a range of regions using current actual customer and system cost data.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Potential bill impacts of dynamic electricity pricing on California utility customers

The rapid growth of renewable generation is creating challenges for the California grid in the form of the “duck curve,” with increasingly steep ramping required for conventional generation resources in the morning and evening, and growing curtailment of solar resources in midday periods. Time-varying electricity tariffs have received considerable attention as a tool to address these challenges, with a renewed recent focus on the potential for dynamic tariffs that vary to reflect conditions on the grid in near-real time. Consideration of dynamic tariffs may raise concerns about the financial impact on utility customers, especially for those who have limited flexibility to modify their electricity consumption in response. Specific areas of concern include electricity bills, bill volatility, and equity implications related to cost shifting among customer groups. In this paper we leverage smart meter data for more than 400,000 California utility customers, spanning residential, commercial, industrial, and agricultural customers, to assess potential customer bill impacts arising from a multi-component dynamic tariff . Specifically, we compute impacts on customer bills and bill volatility under the assumption of fully inelastic demand, i.e., where customers do not change their consumption patterns in response to the tariff. We also assess various approaches designing subscription load shapes that customers can pre-purchase as a hedge that may provide a measure of protection against large negative impacts, while still incentivizing the modification of loads on the margin. We compare and contrast the relative impacts on different customer classes and discuss benefits and pitfalls of different dynamic tariff structures and subscription load shapes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Hierarchical Model-Free Transactive Control of Building Loads to Support Grid Services

Residential buildings consume 4.4 quads of electricity annually, approximately 37% of the total electricity consumption in the United States. This represents a vast resource that can be used for demand management and other ancillary services. This project aims to develop a robust, scalable hierarchical transactional control mechanism incorporating elements of model-free control (MFC) and game theory to harness buildings to provide ancillary services to the grid. This approach is being taken to address the challenges of incorporating traditional transactional control schemes into existing buildings. The challenges include small individual building sizes requiring aggregation of many buildings, unpredictable energy usage that makes model identification difficult, and satisfying the sensitive occupant comfort constraints. In the proposed approach, by separating the control mechanism into two layers above and below the load aggregator, MFC can be used below the aggregator to modulate flexible building loads in response to pricing signals with guaranteed performance. This allows the burden of identifying an accurate model of the system to be shifted to the above-aggregator layer, where fluctuations in individual building usage have less impact on predicted building system behavior. Game theory concepts can then be used to determine pricing curves and control signals among regional aggregators. Managing this control in a game-theoretic approach will allow us to build in financial incentives that increase customer engagement. Additionally, the usage of MFC necessitates less burdensome computational and communication requirements, thus, it is easily deployable on small, embedded devices. In a broader sense, developing a strategy capable of effectively incorporating residential and small commercial buildings will allow greater throughput of existing and emerging grid services in addition to future transactive energy grid management methods. Using MFC within a hierarchical control architecture will allow the shifting of existing forecasting challenges to an aggregate level, where dynamics are slower and more predictable. This will enable a smooth interface between the grid services requests of utilities and the reliable control required by participating buildings. MFC, which supports distributed control architecture, permits a scalable solution that can be deployed to neighborhood-size systems as well as individual buildings. This project focuses on three objectives: (1) developing the mathematical framework, algorithm toolkit, and software toolset of the two-layer transactive control testbed; (2) developing a scalable solution for application over many residential and small-size commercial buildings with sparse distributed communication; and (3) field testing and implementation on hardware of the control strategies developed in the previous two objectives. The research and development activities are focused and designed to be impactful within the relevant 2025 targets timeframe. An open-source control framework for exploiting variability and dispatchability of building loads will be delivered as the outcome of the project. This capability enables greater participation of loads in electricity markets and ancillary services that are both useful for the utility and financially beneficial for building owners.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

AI-Driven Smart Community Control for Accelerating PV Adoption and Enhancing Grid Resilience

The U.S. Department of Energy (DOE) has launched a Connected Communities program that supports projects that expand DOE's network of grid-interactive, efficient building communities nationwide. As an early pilot of Connected Communities, the National Renewable Energy Laboratory (NREL) and its partners have developed and demonstrated a community-scale, hierarchical control solution to address the potential grid issues arising from high penetration of solar photovoltaics (PV) as well as to improve grid reliability and resilience in this residential community. A field pilot study has been performed at an affordable housing development called the Basalt Vista Community, which was built for school teachers and other professionals in the local workforce and represents an autonomous energy grid with all-electric, energy-efficient homes. With no natural gas line in the community, this is the first all-electric net-zero community in rural Colorado. In the field pilot study, NREL has validated the performance of the hierarchical control solution, which consists of NREL's foresee home energy management systems (HEMS) and community aggregators, in increasing demand flexibility and self-consuming PV, reducing potential over-voltages, and supporting critical loads during emergency events. In this presentation, we will present the methodology, simulation and field pilot results, and lessons learned from the project.

all-electric community↗

DOE OSTI2021

Towards a Techno-Economic Analysis of PCM Integrated Hybrid HVAC Systems

Thermal end uses dominate building energy consumption and are a major driver of peak demand. As heating is electrified, peak electrical power required will surge, prompting a need for innovative HVAC system designs and controls.These designs must incorporate novel technologies at the component level and new integration techniques at the system level. One such possibility involves the addition of thermal energy storage (TES) in heating and cooling equipment using a phase change material (PCM) heat exchanger. Here, thermal energy storage via phase change can be used to shift the HVAC system loads to times of lower electricity cost, reduced carbon intensity, and greater energy efficiency. Most of the current utilization of PCM in buildings involves passive components. By actively controlling when heat is stored and released from PCM, we can optimize the building HVAC system to cost-effectively meet consumer needs with the flexibility to draw on renewable energy resources when they are abundant and available. While this combination of technologies is promising in theory, simulation-based evaluation of a prototype can be difficult due to the modeling requirements at the component level and the large number of possible configurations and operating modes at the system level. To conduct this evaluation, we use the Modelica language for modeling and simulation because it enables users to represent the important physics of the problem, interchange and rearrange components in an efficient manner, and implement a range of control configurations. In this work, we considered three case studies: a portable building, a large commercial retail store, and a multifamily residential apartment unit. Each of these employs a different system design, ranging from a single package vertical unit incorporating PCM to a central plant with independent heat pump, evaporative cooling, and thermal energy storage components. This paper describes the technologies in question, presents modeling at the component and system levels, and demonstrates building energy and demand charge cost savings with local time-of-use tariffs in a hot-dry climate.

Helmns, Dre↗

DOE OSTI2023

Impact of Control on Availability and Cycling of Residential HVAC in a Real-World Experiment

Demand response is an important emerging part of smart grids and there is a large stream of research from theoretical and modeling perspectives. However, there is relatively little experimental evidence that could help researchers and building operators make informed decisions on best practices for modeling, developing, and deployment of control mechanisms. We contribute to the body of experimental research by providing numerical insights into the role and availability of residential HVAC systems for control. We share the findings on the duration of the cooling cycle, off cycle, and temperature settling time of HVAC systems from data collected from a smart neighborhood located in Atlanta, GA.

cycling↗

DOE OSTI2026

Storing Affordability: Battery Storage as an Asset to Reduce Data Center Cost Shifts

This report examines how battery energy storage systems (BESS) can help utilities accommodate large load growth while protecting affordability for existing ratepayers. Rapid growth in electricity demand from artificial intelligence (AI) data centers is straining the U.S. grid. Furthermore, many new data centers are entering rural markets, which could offer economic benefits but may also pose implementation challenges for smaller utilities. At the same time, retail electricity prices are increasing faster than inflation, elevating customer affordability as a key challenge. While data centers have not been the primary driver of increases in residential prices to date, they have pushed wholesale energy and capacity prices higher in several markets. Fundamental utility cost-allocation principles show that data center growth can be rate-positive for existing customers only if new peak demand grows faster than the costs a utility must incur to serve it. Several factors, including a utility’s degree of wholesale market exposure, forecast uncertainty and stranded-asset risk, and tariff design can determine the outcome of load growth on retail rates. Energy storage can make several affordability contributions in the face of this landscape of uncertainty and market volatility, including deferral of higher-cost grid investments through improved utilization of existing assets and flexibility of new large loads, insulation from volatile wholesale prices through peak shaving, and reliability support to address grid risks stemming from the behavior of AI data center loads. Different potential BESS deployment pathways—utility-scale front-of-the-meter systems, aggregated small-scale storage installations, and data center-sited behind-the-meter storage—are compared against each other and against conventional capacity alternatives. This framework is intended as a conceptual resource to utilities, particularly smaller public utilities with rural service territories, who may be considering the role that energy storage can play in insulating existing ratepayers from data center cost shifts.

25 ENERGY STORAGE↗

DOE OSTI2022

End-Use Load Profiles for the U.S. Building Stock: Methodology and Results of Model Calibration, Validation, and Uncertainty Quantification

The United States is embarking on an ambitious transition to a 100% clean energy economy by 2050, which will require improving the flexibility of electric grids. One way to achieve grid flexibility is to shed or shift demand to align with changing grid needs. To facilitate this, it is critical to understand how and when energy is used. High- quality end-use load profiles (EULPs) provide this information, and can help cities, states, and utilities understand the time-sensitive value of energy efficiency, demand response, and distributed energy resources. Publicly available EULPs have traditionally had limited application because of age and incomplete geographic representation (Frick, Eckman, and Goldman 2017; Frick 2019). To help fill this gap, the U.S. Department of Energy (DOE) funded a three-year project - End-Use Load Profiles for the U.S. Building Stock - that culminated in the release of a publicly available dataset1 of simulated EULPs representing residential and commercial buildings across the contiguous United States. The motivation for this work is further detailed in a November 2019 report: Market Needs, Use Cases, and Data Gaps (Mims Frick et al. 2019). This Methodology and Results report provides detailed descriptions of how the dataset was developed, intended for an audience of dataset and model users interested in the technical details. These details include descriptions of all of the model improvements made for calibration and the final comparisons to empirical data sources. A companion report, End-Use Load Profiles for the U.S. Building Stock: Applications and Opportunities, will be published subsequently and will describe example applications and considerations for using the dataset, intended for an audience of general dataset users.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Field Study of Grid-connected Heat Pump Water Heaters in the Southeast U.S.: The Next Right Thing

The integration of grid-connected functionality and advanced control algorithms into heat pump water heaters (HPWH) offers the capability to shift load with minimal customer impact. This capability provides a flexible grid resource to utilities, while the increased energy efficiency of HPWHs offers customers a lower electric bill. The combined utility/customer value from grid-connected HPWHs is compelling in the Southeast U.S. where residential electric water heating is prevalent and utility load management is common. This paper presents the results of a HPWH load shifting study conducted in Central Florida using the CTA-2045 standard. Building upon previous research in the Pacific Northwest, this study consisted of approximately 45 occupied homes equipped with HPWHs undergoing load shifting strategies weekly for over a year. Curtailment durations ranged from three to five hours in the morning, and four to five hours in the evening to coincide with high-value periods for utility coincident load for system-wide electric demand reductions. During the morning and afternoon, a one- or two-hour load-up event preceded curtailment. Baseline data were collected across varied Florida weather in which no load shifting events were implemented. Results from traditional load shifting strategies were analyzed across seasons and used to devise unique load shifting approaches to increase renewable energy use during periods of high solar energy generation. Regional impacts are forecasted for large-scale implementation of strategies. Lessons learned and recommendations are also provided for how utilities, manufacturers, and regional planners can maximize load shifting benefits from grid-connected HPWHs.

Heat pump water heaters, residential building, loa↗

DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Hierarchical Model-Free Transactional Control of Building Loads to Support Grid Services

A transition from generation on demand to consumption on demand is one of the solutions to overcome the many limitations associated with the higher penetration of renewable energy sources. Such a transition, however, requires a considerable amount of load flexibility in the demand side. Demand response (DR) programs can reveal and utilize this demand flexibility by enabling the participation of a large number of grid-interactive efficient buildings (GEB). Existing approaches on DR require significant modelling or training efforts, are computationally expensive, and do not guarantee the satisfaction of end users. To address the aforementioned limitations, this software code considers a scalable hierarchical model-free transactional control approach that incorporates elements of virtual battery, game theory, and model-free control (MFC) mechanisms. The developed approach separates the control mechanism into upper and lower levels. The MFC modulates the flexible GEB in the lower level with guaranteed thermal comfort of end users in response to the optimal pricing and power signals determined in the upper layer using a Stackelberg game integrated with aggregate virtual battery constraints. Additionally, the usage of MFC necessitates less burdensome computational and communication requirements, thus, it is easily deployable even on small, embedded devices. This software code enables the use of residential and small-size commercial buildings to offer a potentially substantial source of ancillary grid services that are currently underutilized. A hierarchical, model-free transactive building control provides a smooth interface between the grid service requests of utilities and the reliable control required by participating buildings. Model-free control, which supports distributed control architecture, will be a more scalable solution that can be deployed in neighborhood-size systems as well as individual buildings. The proposed approach contributes to the body of knowledge on two main aspects. First, it couples the MFC with the game-theoretic control and proposes a scalable model-free transactive control approach. MFC does not require any modeling effort or model training for the various building loads. This is very beneficial since deriving an accurate model for every single unit participating in DR programs and obtaining all the parameters about the units (e.g., thermal coefficients, standby losses) are infeasible. Also, MFC is computationally efficient, easily deployable even on small, embedded devices, and can be implemented in real time. Second, it integrates the concept of virtual battery into DR via the Stackelberg game. The concept of virtual battery enables efficient coordination and aggregation of a large number of flexible GEB with guaranteed thermal comfort of end users.

Olama, Mohammed [Oak Ridge National Lab. (ORNL), O↗

DOE OSTI2022

AI-Driven Smart Community Control for Accelerating PV Adoption and Enhancing Grid Resilience

Rapid deployment of residential photovoltaic (PV) systems helps decarbonize our electricity supplies, but under certain circumstances, high-penetration PV may pose challenges to the electrical distribution grid. In a project funded by the U.S. Department of Energy's Solar Energy Technologies Office and Building Technologies Office, the National Renewable Energy Laboratory and its partners studied how flexible building loads and battery storage, when coordinated at home-level and community-level scales, can be used to address those challenges and enhance grid resilience. In this webinar, we will discuss the methodology, simulation and field pilot results, insights from partners, and lessons learned from the project.

artificial intelligence↗