Search NASA⌕ Search

SEARCH · Search NASA

Results for “optimal load shedding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

72 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Proactive Frequency Stability Scheme: A Distributed Framework Based on Particle Filters and Synchrophasors

The reactive nature of traditional under-frequency load shedding schemes can lead to delayed response and unnecessary loss of load. This work presents a proactive framework for power system frequency stability. Bayesian filters and synchrophasors are leveraged to produce predictions after disturbances are detected. By being able to estimate the future state of frequency corrective actions can be taken before the system reaches a critical condition. This proactive approach makes it possible to optimize the response to a disturbance, which results in a decrease in the amount of compensation utilized. The framework is tested via Matlab simulations based on Kundur’s Two-Area System, and the IEEE 14-Bus System. Performance metrics are provided and evaluated against other contemporary solutions found in literature. During testing this framework outperformed other solutions by drastically reducing the amount of load dropped during compensation.

42 ENGINEERING↗
DOE OSTI2025

A method for assessing economic, environmental, and reliability tradeoffs of interregional transmission connecting ERCOT (the Texas grid) to the eastern and western grids

Reliable development of the power grid is an evolving concern for humanity due to extreme weather that frequently threatens power sector infrastructure. The state of Texas is a uniquely structured testbed for grid planners to study when looking for solutions to development, innovation, and overcoming such challenges. Because of its size and islanded structure, Texas is small enough to model, but big enough to matter. Texas is a global leader in energy production, energy consumption, and maintains an unusually diverse fuel mix. In addition, the state has experienced winter freezes, heat waves, wind storms, droughts and floods that have threatened power sector infrastructure or caused recent blackouts and calls for demand side conservation. One of the most devastating of these events was the North American winter storm, dubbed “Winter Storm Uri” by the Weather Channel, that froze the region in February 2021 and led to an extended power outage event that put the majority of Texan residents in darkness for days. While preparing to avoid such outage events in the future, various tools have been proposed to improve grid reliability, including energy efficiency, demand response, and distributed energy resources. An additional option would be to develop interregional transmission that connects the Texas grid to other national grids. To assess the merits of this idea, we developed a novel, universally-applicable and internationally-relevant framework to study how the Texas grid would evolve alongside access to various interregional ties. This method allows us to stress the synthetic grid structure and analyze how it would respond to the shock of a simulated winter storm event. Our method leverages open-source modeling tools, such as PowerGenome, pyGRETA, and GenX to synthesize unique zonal grid data, construct a consolidated network of model regions, and simulate different developmental pathways of capacity expansion and operational dispatch. We demonstrate our method with an analysis connecting the Electric Reliability Council of Texas (ERCOT), the grid that serves most of Texas, the Western Electricity Coordinating Council (WECC), the grid that serves the western half of the contiguous U.S., and the Eastern Interconnect, the grid that serves the eastern half of the contiguous U.S. Our results indicate that the cost-optimal capacity of interregional transmission connecting the ERCOT grid to other grids lies between 9–13 GW assuming baseline conditions. Building this amount of connecting capacity in one or multiple directions lowers the costs and emissions of development and operation by up to $16 billion and 257 million metric tonnes (MMT) respectively. Additionally, our results show that the interregional connections between ERCOT and other national grids reduce the amount of total load shed required through mild winter storm events. However, our results also show that there is a threshold of very extreme winter storm conditions, spanning multiple service areas, above which the connections exacerbate resource adequacy problems. Therefore, the results indicate that the connections need to be carefully planned alongside the rest of the grid infrastructure to avoid over-reliance on specific resources or technology options.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Strategic Placement and Sizing of Distributed Generation for Resilience Enhancement of Distribution Grids With Microgrid Formation

The rise in frequency and severity of extreme weather events highlights the need for resilient power distribution networks. Microgrids can help improve the resilience of distribution grids by providing continuous power supply using local distribution generation (DG) when the distribution grid fails. In this paper, we propose an approach for optimal placement and sizing of DG to form multiple microgrids throughout the distribution network by restoration actions such as switching operations in case of distribution grid outages caused by extreme weather events. Considering the randomness of damaged distribution lines, the DG placement and sizing problem is formulated as a two-stage stochastic mixed-integer program, with the first stage determining the placement and size of DG, and the second stage focusing on minimizing the amount of load shedding through network restoration and microgrid formations for each scenario. Due to the large number of scenarios, the sample average approximation (SAA) method is employed to solve the problem. The results of case studies on a modified IEEE 33 bus distribution grid demonstrate the effectiveness of the proposed DG placement and sizing strategy in improving the resilience of distribution grids by allowing the formation of multiple microgrids. In addition, the robustness and accuracy of the SAA method are validated through various case studies.

Distributed generation planning↗
DOE OSTI2022

Network Reconfiguration for Enhanced Operational Resilience Using Reinforcement Learning

This paper proposes a reinforcement learning-based approach for distribution network reconfiguration(DNR) to enhance the resilience of the electric power supply. Resilience enhancements usually require solving large-scale stochastic optimization problems that are computationally expensive and sometimes infeasible. The exceptional performance of reinforcement learning techniques has encouraged their adoption in various power system control studies, specifically resilience-based real-time applications. In this paper, a single agent framework is developed using an Actor-Critic algorithm (ACA) to determine statuses of tie-switches in a distribution feeder impacted by an extreme weather event. The proposed approach provides a fast-acting control algorithm that reconfigures the feeder topology to reduce or even avoid load shedding. The problem is formulated as a discrete Markov decision process in such a way that a system state captures the system topology and its operational characteristics. An action is made to open or close a specific set of tie-switches after which a reward is calculated to evaluate the practicality and advantage of that action. The iterative Markov process is used to train the proposed ACA under diverse failure scenarios and is demonstrated on the 33-node distribution feeder system. Results show the capability of the proposed ACA to determine proper switching action of tie-switches with accuracy exceeding 93%.

actor critic↗
DOE OSTI2021

Physics-Informed Evolutionary Strategy Based Control for Mitigating Delayed Voltage Recovery

Here, in this work we propose a novel data-driven, real-time power system voltage stability control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to secure system voltage stability. The problem is challenging due to the high-dimensional feature of the power system model and the fast-changing and uncertain nature of power system operation scenarios. To this end, a model-free and derivative-free guided ES method is applied. The method is further combined with a meta-learning strategy to make the learnt control policy automatically adapted to unseen operation conditions and fault scenarios, which is highly desired for real-time emergency control. Last but not least, physical knowledge is embedded in the above method through a trainable action mask technique to rule out unnecessary load shedding actions for better learning and control performance. Case studies on the IEEE 300-bus system and comparisons with other state-of-the-art benchmark methods verify the superiority of the proposed physics-informed guided meta ES method in realizing fast and adaptive power system voltage stability control.

42 ENGINEERING↗
DOE OSTI2025

Deep Reinforcement Learning Based Control of Wind Turbines for Fast Frequency Response

In order to fulfill vital auxiliary grid services, such as load regulation, spin and non-spin reserve provision, and frequency support during emergencies, there is often a requirement for certain wind farms to operate in de-loaded modes. Leveraging the swift response capabilities of wind farms, this study demonstrates that reserving power in de-loaded modes can significantly enhance power grid stability and reliability during system contingencies. Controlling wind farms optimally for frequency support is intricate due to the nonlinearity of models and controllers and the complexity of wind farm interactions with power systems. Here, to address this challenge, this paper introduces a novel approach that integrates wind turbines into reinforcement learning-based solutions for frequency response. This innovative methodology utilizes the state-of-the-art reinforcement learning algorithm known as the surrogate-gradient-based evolutionary strategy. The proposed learning-based algorithm provides continuous control of wind farm output to rapidly stabilize system frequency and prevent unnecessary trips of under-frequency load shedding relays. To facilitate efficient training, parallel computing techniques are employed. The proposed methodology is evaluated on a modified IEEE-39 bus system, and simulation results reveal its efficacy in reliably supporting power system frequency and preventing the need for unnecessary load shedding.

Gao, Wei [Argonne National Laboratory (ANL), Argon↗
DOE OSTI2024

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗
DOE OSTI2022

Managing Power Systems-Induced Wildfire Risks Using Optimal Scheduled Shutoffs

The increasing demands for electricity and the increase in extreme weather conditions are putting unprecedented pressure on our electric grids. Often, this pressure leads to electrical component failures, which might ignite wildfires. This work develops a novel model to balance the reliability of power network operations and the risk of wildfire ignition by opti- mizing the operational schedule of power transmission networks considering time-varying risk measures that include exogenous and operational factors. Energy storage systems are considered to deliver power during peak wildfire hours and enable temporal load shifting. The problem is formulated as a mixed-integer linear program that maximizes a weighted sum of the served power demand and the reduction in grid-induced wildfire risk. The results demonstrate the ability of the model to significantly reduce wildfire risk without considerable load shedding.

power systems operations↗
DOE OSTI2021

Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency

Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Polymer–Ceramic Composite Electrolytes for Lithium Batteries: A Comparison between the Single-Ion-Conducting Polymer Matrix and Its Counterpart

Single-ion-conducting polymer electrolytes are attractive to use in lithium batteries as the transference number of the lithium cation approaches unity. This helps prevent concentration gradients across the electrolyte, which can result in dendrite formation. The addition of ceramic particles to polymer electrolytes at high loadings can increase the mechanical strength of the polymer, which can also help suppress dendrite formation. Here, a single-ion-conducting polymer electrolyte is blended with lithium-conducting oxide ceramic particles to make a composite electrolyte. This electrolyte is studied in comparison to a composite electrolyte containing freely dissolved lithium salt. It is found that the addition of ceramic particles to the single-ion-conducting polymer can result in increased cation dissociation and consequent increased ionic conductivity. The electrolytes are cycled in lithium symmetrical cells, and it is found that the ceramic-containing electrolytes show increased interfacial stability with the lithium metal compared to the pristine polymer electrolytes. Our findings shed light on how to optimize the polymer host chemistry to form composite electrolytes that can meet the challenging requirements to stabilize the lithium metal anode.

25 ENERGY STORAGE↗
DOE OSTI2021

GT Flex: A Coordinated Multi-Building Pilot Study

Buildings are a significant and untapped resource for providing utility electric grid services. Recent studies have estimated that buildings could reduce the peak demand on the electric grid in the U.S. by almost 25% through effective combinations of energy efficiency (EE) measures and load flexibility strategies (Langevin et al. 2021). The U.S. Department of Energy (DOE) has established a goal to triple energy efficiency and demand flexibility in both residential and commercial sections by 2030 compared to 2020 levels (Satchwell et al. 2021). Such findings place buildings alongside electric vehicles, photovoltaics, electric batteries, and other distributed energy resources (DERs) as primary technologies needed for supporting high renewable energy generation grids. Coordinating and optimizing multiple buildings and other DERs is more beneficial and valuable when compared with individual buildings and DERs operating as siloed resources, uncoordinated with others (Olgyay et al. 2020). A pilot study at the Georgia Institute of Technology (GIT) was conducted to evaluate value propositions of a multi-building scale project seeking carbon reduction, energy efficiency and grid-interactive capabilities, by demonstrating the means by which stakeholders can determine the technical and financial merits of grid-interactivity and energy efficiency technologies coordinated across multiple assets. The study focused on analyzing technical feasibility of deploying thermal load flexibility strategies at the multi-building scale, coordinated to not exceed existing infrastructure constraints at the pilot site. Results show that campus can provide 3-3.5 MW of potential load shed over a 4-hour event window through coordinated dispatch of thermal cooling load flexibility without exceeding existing infrastructure capacities. Under future high renewable scenarios, this thermal flexibility resource is also valuable when coordinated to reduce curtailment of intermittent renewables. Economic analyses were performed to effectively communicate various value propositions of grid-interactive and efficient building (GEB) thermal flexibility strategies. Load flexibility presents a financial value proposition to the campus today. By conducting rationalized, coordinated dispatch in response to real time price (RTP) fluctuations, the campus can benefit materially from daily price arbitrage. The RTP signal acts as an aggregating mechanism between the utility and customer to call on demand flexibility resources, with a large portion of the benefit deriving from a relatively small number of days. Realizing and maximizing this benefit with thermal load flexibility requires careful attention to the timing of pricing signals and parameterization of dispatch to overcome efficiency penalties. Grid value and signals are expected to evolve over time, and thermal load flexibility shows potential to adapt dispatch logic to support intermittent renewable generation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Self-Organizing Map-Based Resilience Quantification and Resilient Control of Distribution Systems Under Extreme Events

Due to climate change, extreme weather events are occurring more frequently and with increasing impact. This trend poses a significant challenge for distribution system operators (DSO) to ensure that there is uninterrupted power supply to critical loads in their networks. To embed resilience into DSO's decision-making, resilience needs to be first quantified and then integrated into the system-level optimization. Therefore, this paper first develops a novel self-organizing map (SOM) based method (called SomRes) to quantify the time-varying resilience index of a system that can leverage the powerful classification property of SOMs and removes some of the disadvantages of subjective weight assignment methods. Using SomRes, a resilient resource allocation and operational dispatch algorithm is further developed to enhance system resilience against extreme events by considering the SomRes resilience index directly as the feedback. Here, the proposed resilience quantification approach is benchmarked with a state-of-the-art approach and the efficacy of the proposed resilient dispatch algorithm is demonstrated through several deterministic and statistical case studies on the IEEE 123-bus distribution system. Simulation studies show that the proposed SomRes quantification method is an appropriate indicator of system resilience, and the resilient resource allocation and dispatch strategy can significantly reduce critical load shedding under varying event propagation scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Hybrid Power Plants for Energy Resilience: A Case Study

As renewable energy technologies are increasingly adopted, they pose an opportunity to improve the sustainability and resilience of distributed grids, especially when their design and operation is coordinated as a hybrid power plant. When included in hybrid power plants, distributed wind turbines in particular have the potential to enhance the resilience of distributed grids in areas with good wind resource, due to their ability to provide more consistent generation and ancillary services as compared to photo-voltaic (PV) solar panels. Despite this benefit, U.S. distributed wind adoption is lower than other comparable renewable energy technologies. In this study, we seek to demonstrate how hybrid power plants that include distributed wind turbines can contribute to distribution grid resilience by meeting loads (especially critical loads) more consistently, increasing reserve capacity, and providing value to customers during outages. To demonstrate these contributions, we integrate three separate frameworks and apply them to a case study in a rural electric cooperative in Iowa. Through this case study, we simulate and compare hybrid power plant design and operation during two hazard events: a tornado that causes a 48-hour distribution outage and a winter weather event that causes a 6-hour generation outage. The inclusion of a hybrid power plant that leverages 1) increased battery duration and 2) advanced forecasting and dispatch strategies that reserve capacity leading up to a hazard event best reduce lost loads as well as diesel consumption that would otherwise be used to meet those loads during short- and long-duration hazard events. Depending on the hybrid power plant capacity and operation, we find that the outage mitigation value of a hybrid power plant (measured in value to customers to avoid an outage and avoided lost revenues for the utility) is significant in both hazard events; adding wind, solar, and battery assets to the existing system adds about $50-$100M in avoided lost load and at least $4-$8k in utility value in the tornado hazard event, and $570k-$2.2M in avoided lost load and at least $220-$650 in utility value in the winter hazard scenario. In both the tornado and winter hazard scenarios, optimizing the operation of the hybrid system for resilience can lend similar value as increasing battery duration by 5 MWh for the lower capacity systems considered.

17 WIND ENERGY↗
DOE OSTI2022

Uniform lithiophilic layers in 3D current collectors enable ultrastable solid electrolyte interphase for high-performance lithium metal batteries

Uniform lithium plating/stripping during charging/discharging in 3D lithiophilic current collectors (3DLCC) is essential to suppress growth of lithium dendrites and to mitigate infinite volume variations of lithium metal for long-lived lithium metal batteries. Additionally, this study reveals the decisive role played by uniformity of the lithiophilic layer of the 3DLCC in achieving uniform lithium plating/stripping. Herein, a series of metal oxide-based 3DLCCs are successfully fabricated with a simple and an ultrafast solution combustion method, from which formation of a uniform and stable lithium dendrite-free solid electrolyte interphase via a uniform lithiophilic layer is demonstrated. Taking Co 3 O 4 as the lithiophilic material deposited on a nickel foam as the 3DLCC (Co@NF) for a proof of concept, the loading amount of Co 3 O 4 , closely correlated with the uniformity of the Co 3 O 4 layer, is modulated to optimize its lithium ion hosting performances. With a uniform Co 3 O 4 layer grown in the 3DLCC, an ultralow nucleation overpotential of 33.4 mV is achieved in half-cell tests at 1 mA cm -2 and 1 mAh cm -2 , and a high Coulombic efficiency of 97.1% is maintained after 210 cycles under a severe cycling condition of 2 mA cm -2 and 1 mAh cm -2 . A small polarization voltage of 13 mV together with an ultralong cycle life of 2400 h at 0.5 mA cm -2 and 1 mAh cm -2 in symmetric Li cells is achieved. Moreover, the composite Li anode delivers sensational rate capability and cyclability in full-cells. This work not only provides new and valuable insights into the interphasial chemistry of solid electrolyte interphase layers, but also sheds light on the development of ultrastable lithium metal batteries.

25 ENERGY STORAGE↗
DOE OSTI2020

Revisiting the Role of Conductivity and Polarity of Host Materials for Long-Life Lithium–Sulfur Battery

Despite their high theoretical energy density and low cost, lithium-sulfur batteries (LSBs) suffer from poor cycle life and low energy efficiency owing to the polysulfides shuttle and the electronic insulating nature of sulfur. Conductivity and polarity are two critical parameters for the search of optimal sulfur host materials. However, their role in immobilizing polysulfides and enhancing redox kinetics for long-life LSBs are not fully understood. In this work we have conducted an evaluation on the role of polarity over conductivity by using a polar but nonconductive platelet ordered mesoporous silica (pOMS) and its replica platelet ordered mesoporous carbon (pOMC), which is conductive but nonpolar. It is found that the polar pOMS/S cathode with a sulfur mass fraction of 80 wt% demonstrates outstanding long-term cycle stability for 2000 cycles even at a high current density of 2C. Furthermore, the pOMS/S cathode with a high sulfur loading of 6.5 mg cm -2 illustrates high areal and volumetric capacities with high capacity retention. Complementary physical and electrochemical probes clearly show that surface polarity and structure are more dominant factors for sulfur utilization efficiency and long-life, while the conductivity can be compensated by the conductive agent involved as a required electrode material during electrode preparation. The present findings shed new light on the design principles of sulfur hosts towards long-life and highly efficient LSBs.

25 ENERGY STORAGE↗
DOE OSTI2025

Game Theory Approaches for System-level Incentive Design

This report presents a generalized Stackelberg game framework for designing and evaluating financial incentives that enhance power system resilience through strategic deployment of distributed energy resources(DERs) under various contingencies. The proposed approach addresses the challenge of coordinating individual community investment decisions to meet system-wide resilience objectives. The framework is demonstrated in a three-community test system subjected to two transmission contingency scenarios: inter-community line failure (Case 1) and complete main grid disconnection (Case 2). In both cases, three incentive levels are compared: a Base case with no financial incentives, and low and high incentive cases. In Case 1, the Base case (no incentives) results in a total installed DER capacity of 217.2 MW, with no load shedding due to alternative routing, but community costs remain high. Increasing incentives raises DER deployment to 286.9 MW, lowers aggregate community costs by $22M annually, and completely avoids the need for costly new transmission line construction. In Case 2, the Base case results in 24.3 MWh of unserved load; introducing incentives eliminates all load shedding and ensures up to 89 MWh of battery storage is available for emergency reserve. These results demonstrate that targeted incentives can dramatically improve grid resilience and cost-effectiveness. The framework thus offers policymakers and system planners a robust tool to quantify and compare the effectiveness of incentive programs for multi-community transmission networks behavior, system resilience, and economic efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Scaling Up: Demonstrating Risk Reduction and Cost Compression for Commercial Heat Pump Water Heaters - CRADA 625 (Abstract)

Commercial heat pump water heater (CHPWH) systems significantly decarbonize the commercial and multifamily sectors by eliminating the reliance on gas-fired water heating. CHPWH systems are also well suited to include load shift controls that enable load-up and shed commands for supporting grid reliability and time-of-use pricing structure. However, they have not had wide adoption due to factors including price, complexity, and perceived risk. Although CHPWHs have been available in the US for decades, they have not made significant market gains in part because the systems have required significant and costly engineering design expertise and proved lackluster performance. Successful widespread market adoption requires a different approach; a shift from the current custom specialized expertise project design and installation to a repeatable approach that requires little specialized knowledge or expertise and can deliver persistent performance. Using this type of holistic systems approach requires effectively integrating four CHPWH system key components: primary air-to-water heat pumps; primary thermal storage tanks, a temperature maintenance system, and a control system which has capabilities to manage the primary heat pump cycles, any back-up, supplemental, or temperature maintenance heating, alarms, and grid connectivity allowing for demand response (DR), and/or load shifting. The project team has developed and will implement a suite of tools to support faster, less expensive, and more reliable field installations of CHPWH technology and with the resulting data used to further improve the tool set. These tools include: (1) A tool for optimizing system size and costs. (2) A tool that predicts annual energy use and overall system efficiency. (3) The Advanced Water Heater Specification (AWHS 8.0) defining the components of a full CHPWH system addressing performance requirements by climate zone. (4) The Qualified Products List: (QPL) of approved products that meet the specifications requirements. (5) Training materials including online on-demand modules, instructor-led training, and virtual interactive video tours of CHPWH installations in multifamily buildings. Demonstration site identification in low-income buildings in underserved communities is currently underway. Preliminarily, the team anticipates having three demonstrations in the Pacific Northwest and three in the Northeast for a total of six sites. After the demonstration sites are finalized, and M&V instrumentation installations are complete, the team will gather performance data and confirm whether the CHPWH systems perform as predicted and use the data to improve the existing tools.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗