SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This report is part of a series describing different ResStock measures. "Measures" refers to energy efficiency retrofits that can be applied to buildings during modeling. This documentation covers the "Dual Fuel Heat Pump" measure upgrade methodology and briefly discusses key results.
With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.
Efficient control of Heating, Ventilation, and Air Conditioning (HVAC) systems is crucial for optimizing energy use and maintaining indoor comfort in buildings. Traditional control methods, such as PID control, cannot handle energy use trade-offs among multiple components in the building energy system at a supervisory level. Reinforcement learning (RL) presents a promising solution, offering adaptive and data-driven control strategies that optimize performance over time. However, RL also faces several challenges, including the conflicts encountered in co-optimizing energy savings, occupant comfort, and indoor air quality, and the requirement for extensive interactions with the environment in training. We proposed a flexible simulation platform that integrates a hybrid model for RL training and designed an RL agent to control the entire central HVAC system, focusing on co-optimizing energy consumption, thermal comfort, and indoor air quality ($\text{CO}_{2}$ and PM2.5 concentrations). Finally, we evaluated the RL agent's performance over an annual cycle. Our findings indicate that the RL agent can effectively manage the HVAC system with 14.7 % energy savings annually and balance multiple objectives, which demonstrates significant potential for improving HVAC system control and sustainability in buildings.
Here, this study assesses the techno-economic viability of city-scale building electrification, comparing a base case scenario with conventional HVAC systems to an electrified scenario with heat pump systems. EnergyPlus simulations reveal a 28% increase in annual electricity consumption in the electrified scenario, shifting the peak consumption from summer to winter with a 49% surge. Hybrid renewable energy systems (HRESs) are then evaluated using HOMER Pro, considering renewable penetration from 0% to 100%. The net present cost (NPC) of the base case and electrified scenarios range from $\$10.34$ to $\$24.38$ billion and $\$8.79$ to $\$50.31$ billion, respectively. Sensitivity analysis explores the impact of carbon tax, fuel price, and renewable subsidies on HRESs in the electrified scenario. Results indicate that applying a carbon tax up to $\$120$/tonne of CO 2 increases the optimum renewable fraction from 5% to 26%, while higher fuel prices and renewable subsidies further enhance the feasibility by shifting the optimum renewable fraction to 60% and 54%, respectively, demonstrating the interplay between economic factors and renewable integration in electrified urban contexts.
The evaporative cooling process has been successfully deployed in multiple energy conversion processes such as power generation, process cooling, heating, ventilation & cooling (HVAC), and commercial and industrial refrigeration. The heat exchanger is a very common yet extremely critical component of such systems. The device is important since the performance of the overall cooling system heavily relies on the thermal-hydraulic efficiency of the heat exchanger. The possible wet operation as evaporative cooling heat exchanger complicates the issue. Indeed, based on the hybrid nature of operation (fully dry, partially wet, fully wet) the efficiency can vary significantly and can cause performance variation for the whole system. Understanding the importance of the issue, Oak Ridge National Laboratory (Contractor) and Baltimore Aircoil Company (Participant) propose an activity focused on the analysis of the existing heat exchanger technology used in air and evaporative cooling processes and design, development and demonstration of a novel heat exchanger design based on porous materials. The potential candidates include metallic wire meshes and metal foams carefully designed for the proposed application. Prior research has indicated that these materials have great potential for deployment in thermal systems, particularly heat sinks and heat exchangers. It is expected that the successful completion of the project will lead to novel heat exchanger technology for hybrid systems (capable of dry and wet operation) by exploring newly emerging materials and their potential for heat transfer application. The overall goal is to develop a next generation heat exchanger technology which can be deployed in evaporative cooling systems. The impact of the such development is significant since, it will not only make the overall system highly efficient but will also, reduce the total refrigerant charge in the heat exchanger, a critical aspect for the deployment of refrigerants with lower Global Warming Potential (GWP).
The evaporative cooling process has been successfully deployed in multiple energy conversion processes such as power generation, process cooling, heating, ventilation & cooling (HVAC), and commercial and industrial refrigeration. The heat exchanger is a very common yet extremely critical component of such systems. The device is important since the performance of the overall cooling system heavily relies on the thermal-hydraulic efficiency of the heat exchanger. The possible wet operation as evaporative cooling heat exchanger complicates the issue. Indeed, based on the hybrid nature of operation (fully dry, partially wet, fully wet) the efficiency can vary significantly and can cause performance variation for the whole system. Understanding the importance of the issue, Oak Ridge National Laboratory (Contractor) and Baltimore Aircoil Company (Participant) propose an activity focused on the analysis of the existing heat exchanger technology used in air and evaporative cooling processes and design, development and demonstration of a novel heat exchanger design based on porous materials. The potential candidates include metallic wire meshes and metal foams carefully designed for the proposed application. Prior research has indicated that these materials have great potential for deployment in thermal systems, particularly heat sinks and heat exchangers. It is expected that the successful completion of the project will lead to novel heat exchanger technology for hybrid systems (capable of dry and wet operation) by exploring newly emerging materials and their potential for heat transfer application. The overall goal is to develop a next generation heat exchanger technology which can be deployed in evaporative cooling systems. The impact of the such development is significant since, it will not only make the overall system highly efficient but will also, reduce the total refrigerant charge in the heat exchanger, a critical aspect for the deployment of refrigerants with lower Global Warming Potential (GWP).
The increasing demand for electricity stresses the existing electric grids. Buildings consume 73% of all U.S. electricity and are responsible for 30% of U.S. greenhouse gas emissions. Integrating thermal energy storage (TES) in building heating/cooling systems, which consume considerable electricity, can mitigate the challenges to electric grids. Here, this study reports on a novel thermal energy storage device integrated heat pump system to reshape the building electricity demand profile while maintaining thermal comfort. The annual performance of the proposed system has been evaluated through a dynamic system simulation with high fidelity in the Modelica platform. The dynamic model of the novel hybrid component named ‘dual purpose underground thermal battery’ was developed and validated. It was then incorporated into the system model. Given a time-of-use tariff, a rule-based control strategy was designed to shift the electric demand and switch the heat pump source for a typical single-family house in different climate zones of the United States. The system performance of the new TES-integrated dual-source heat pump was compared with that of a conventional air-source heat pump system. The results indicate that the proposed system can reduce the annual HVAC electricity cost by up to 52% while saving 45.2% on electricity consumption. In the Northern areas, the annual peak load of the HVAC system can be reduced by 64.9%. However, this reduction is less in the Southern areas as the system’s higher efficiency in winter dominates the overall energy-saving potential.
Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.
This chapter highlights the critical need for advanced modeling of data centers due to their rapidly increasing energy consumption and impact on grid reliability. Driven by the demand for AI applications, data centers are projected to consume a significant portion of US energy by 2028, putting stress on an already challenged power grid. The chapter emphasizes the importance of "fast" time-scale models to understand the dynamic interactions between data centers and the grid, especially given the rapid power fluctuations of AI workloads. It outlines a modeling framework that includes both offline and real-time EMT domain simulations, detailing the necessary representations for various components like utility interfaces, transformers, IT loads, UPS, cooling loads, Battery Energy Storage Systems (BESS), generators, protection systems, and higher-level control systems. While standard simulation tools like PSCAD offer basic models, custom development is often required to accurately capture the unique and fast-changing behaviors of modern data centers. The chapter also discusses key metrics and test cases for validating these models, focusing on transient load responses, protection relay coordination, and demand flexibility. Finally, it addresses the challenges of modeling large-scale data centers, such as computational complexity and the trade-off between model fidelity and practicality, suggesting hybrid modeling approaches as a solution. The overarching goal is to create a robust framework that helps assess data center impacts on grid stability, identify vulnerabilities, and inform the development of standards for reliable integration of these large loads into the bulk power system.
Thermal energy storage is anticipated to play an important role in developing the power grid of the future - a power grid that meets increasing demands of users, is resistant to disruptions, but also allows for greater penetration of renewable resources. Specifically, thermal energy storage materials can be integrated into HVAC systems and building envelopes, where they can be used to shift power demands for building climate control from periods of peak demand to periods of low demand. Phase change materials (PCMs) are compelling as low-cost, high energy density thermal energy storage materials for building thermal management. However, there is a lack of high performance low-cost PCMs within the specific temperature ranges which would most effectively allow for power load shifting. Inorganic salt hydrates represent a promising class of PCMs, but their inherent limitations cause them to be currently unavailable for reliable building applications. The overarching goals of this research effort are to: 1) Discover low-cost, high volumetric density salt hydrate eutectic PCMs to store low-quality heat (10 to 40 °C); 2) Introduce a high thermal conductivity matrix to reduce the time constant for energy storage to ~0.1 to 1 hr, incorporate nucleation catalysts to decrease undercooling, and utilize microencapsulation and shape stabilization approaches, minimizing moisture loss/gain, mitigating phase separation, and maintaining stable melting behavior over the lifetime of the compounds; 3) Evaluate the impact these systems have on peak load shifting, and the potential for overall energy savings under different climatic scenarios and building configurations. These goals will be achieved by an integrated research program consisting of six cohesive research subtasks: 1) Materials discovery of eutectic salt hydrate PCMs by using computationally predicted thermodynamic equilibria, coupled with high-throughput experimental validation, 2) Rapid experimental screening of nucleation catalysts identified through robust computational databases, 3) Embedding salt hydrate PCM into a low cost and scalable high conductivity matrix, 4) Microencapsulation of salt hydrate microspheres using hybrid inorganic-polymer microencapsulation approach, 5) Shape stabilization by thermoreversible salt hydrate salogels, and 6) Analysis of end-use using thermal simulations, and characterization of mock-up energy storage finished components.
Geothermal heating and cooling (GHC) systems offer one of the most efficient approaches to provide space conditioning and water heating in buildings. Due to the relatively stable temperature of the ground year-round, these systems can provide an efficient solution to decarbonize heating systems. Yet this technology has faced limited market adoption due to its high first cost. This project seeks to address this barrier by designing a community GHC system at a public housing development in New York, taking advantage of load diversity (in terms of the timing and amount of heating / cooling used per person) that a larger community offers to reduce the size and thus first cost of a GHC system. Project success would result in societal benefit from reduced energy and fossil fuel use, reduced local emissions, and improved comfort, which would positively impact the health and well-being this community. This report presents the findings from Phase 1 project supported by the Department of Energy’s Geothermal Technologies Office and includes the technical design of a GHC at a public housing development in New York. To support the success of a potential deployment of a GHC system, the team conducted community engagement and prepared an assessment of the local workforce needs. The project team, led by EPRI, considered a subset of NYCHA housing developments that were previously identified by NYCHA as suitable for GHC retrofits. This report presents the site selection criteria the team developed and the overall score assigned to each of the eight developments considered. One site was selected for focus of the technical design: Stapleton Houses in Staten Island, a mid-size development with roughly 700 apartments across 6 buildings. The site has an existing hot water hydronic loop served by natural gas boilers for space heating and water heating. The technical design partner assessed baseline energy consumption at the site and established thermal models of the apartment buildings to assist in the design. The team considered several GHC system configurations and selected a hybrid geothermal design fed from water-source heat pumps with auxiliary gas boilers in a central plant. This design best leveraged the existing site configuration and minimized costs due to additional electrical infrastructure upgrades. The report also details the feedback received from community engagement efforts and the findings from the workforce needs assessment and workforce transition plan. Members of the site maintenance staff and the resident advisory council were interviewed for their input and feedback about both the site’s existing heating/cooling infrastructure and how a construction project would impact resident life. This feedback was taken into consideration when completing the geothermal system design. Research was conducted into existing workforce development opportunities available to NYCHA residents. A workforce development plan was established using information from NYCHA’s resident economic empowerment and sustainability group, along with training material and curriculum from the International Ground Source Heat Pump Association (IGSHPA).