Search NASA⌕ Search

Engineering topics

Grant, David

Publications and source records attributed to Grant, David.

A Digital Twin Framework for Liquid-cooled Supercomputers as Demonstrated at Exascale

We present ExaDigiT, an open-source framework for developing comprehensive digital twins of liquid-cooled supercomputers. It integrates three main modules: (1) a resource allocator and power simulator, (2) a transient thermo-fluidic cooling model, and (3) an augmented reality model of the supercomputer and central energy plant. The framework enables the study of "what-if" scenarios, system optimizations, and virtual prototyping of future systems. Using Frontier as a case study, we demonstrate the framework's capabilities by replaying six months of system telemetry for systematic verification and validation. Such a comprehensive analysis of a liquid-cooled exascale supercomputer is the first of its kind. ExaDigiT elucidates complex transient cooling system dynamics, runs synthetic or real workloads, and predicts energy losses due to rectification and voltage conversion. Throughout our paper, we present lessons learned to benefit HPC practitioners developing similar digital twins. We envision the digital twin will be a key enabler for sustainable, energy-efficient supercomputing.

Brewer, Wes↗

Energy dataset of Frontier supercomputer for waste heat recovery

The Hewlett Packard Enterprise–Cray EX Frontier is the world’s first and fastest exascale supercomputer, hosted at the Oak Ridge Leadership Computing Facility in Tennessee, United States. Frontier is a significant electricity consumer, drawing 8–30 MW; this massive energy demand produces significant waste heat, requiring extensive cooling measures. Although harnessing this waste heat for campus heating is a sustainability goal at Oak Ridge National Laboratory (ORNL), the 30 °C–38 °C waste heat temperature poses compatibility issues with standard HVAC systems. Heat pump systems, prevalent in residential settings and some industries, can efficiently upgrade low-quality heat to usable energy for buildings. Thus, heat pump technology powered by renewable electricity offers an efficient, cost-effective solution for substantial waste heat recovery. However, a major challenge is the absence of benchmark data on high-performance computing (HPC) heat generation and waste heat profiles. This paper reports power demand and waste heat measurements from an ORNL HPC data centre, aiming to guide future research on optimizing waste heat recovery in large-scale data centres, especially those of HPC calibre.

97 MATHEMATICS AND COMPUTING↗

Thermo-Fluid Modeling Framework for Supercomputer Digital Twins: Part 1, Demonstration at Exascale

A thermo-fluid modeling framework is being developed for ExaDigiT---an open-source framework for developing comprehensive digital twins of liquid-cooled supercomputers. The work is being conducted in two parts, and discussion is divided into two companion papers. The work documented in this paper focuses on the development of a cooling system library in Dymola for the Frontier supercomputer at Oak Ridge National Laboratory. The second part, outlined in a companion paper, focuses on a templating structure called Auto-CSM for easily creating model-agnostic, physics-based thermo-fluid cooling system models for liquid-cooled supercomputers using a text-based schema. The cooling model is being developed using primarily the open-source Transient Simulation Framework of Reconfigurable Models (TRANSFORM) library. The library follows the templating architecture developed within the TRANSFORM library for modeling subsystems. A full-system validation was performed to validate a very simple model that is integrated with the system controls, and the results are presented herein.

Kumar, Vineet↗

District heating utilizing waste heat of a data center: High-temperature heat pumps

Data centers are energy-intensive facilities with substantial low-grade waste heat. High-temperature heat pumps can be critical in boosting the data center’s waste heat for district heating, improving the system-level energy efficiency of data centers, and reducing CO 2 emissions in district heating. This study built thermodynamic models to assess high-temperature heat pumps with six configurations using low global warming potential refrigerants to supply heat up to 120 °C. The heat pump configurations include single-stage or two-stage cycles with advanced components, such as internal heat exchanger, economizer, flash tank, or parallel compressor. The refrigerants include R1234ze(Z), R1233ed(E), R1224yd(Z), R600, and R600a, and R245fa is used as a reference. A case study was carried out to recover the waste heat from the Frontier high-performance computing data center and provide hot water for district heating at the US Department of Energy’s Oak Ridge National Laboratory campus. The optimized performance of high-temperature heat pumps is characterized with various effectiveness of internal heat exchangers, and the operating parameters of economizer or flash tank, as well as their combination. The results show that the configurations of two-stage cycles with internal heat exchanger + flash tank and internal heat exchanger + economizer/parallel-compressor provide the highest coefficient of performance under scenarios of the maximum allowable value and a fixed value (0.3) of the internal heat exchangers’ effectiveness, respectively. R1234ze(Z) and R600a are the most promising refrigerants, considering trade-offs between the coefficient of performance and the volumetric heating capacity. The single-stage cycle with internal heat exchanger + economizer/parallel-compressor using R1234ze(Z) is recommended for utilizing Fronter’s waste heat in district heating. A one mega-watt high-temperature heat pump will reduce 33,100–33,200 metric tons of CO2 emission annually, corresponding to 85.4 %–85.6 % of equivalent CO2 emissions from natural gas boilers. Here, this study provides good guidelines for designing and deploying high-temperature heat pumps to support sustainable data centers and decarbonize district heating in the US.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ORNL Campus Sustainability and Decarbonization using Waste Heat Recovery from the Oak Ridge Leadership Computing Facility’s High-Performance Computing Data Center

Heat pumps are a clean and efficient technology that can be powered by renewable electricity to transfer heat using a refrigerant from one place to another by different heat sources, making buildings clean and environmentally friendly. With the support of the ORNL Laboratory Modernization Division, this project explored and evaluated an innovative solution that uses water-water cost-effective midtemperature heat pump (MTHP) technology to leverage the low-grade waste heat from ORNL Frontier and the data center to deliver 85°C hot water, which replaces hot steam generated using natural gas combustion boilers for water heating or space heating in the buildings of ORNL campus. Two scenarios were studied. In the first scenario, which considered the 5600-5700-5800 complex only, Carrier’s commercial 1,000 kW MTHP technology achieves more than 6,640 MWh/year energy savings, an emission reduction of 858 TCO2e/year CO2, and a payback time of 4.85 years. In the second scenario, which considered the 5600-5700-5800 complex and Buildings 5100, 5200, and 5300, the CO2 emission reduction is 1,483 TCO2e/year, the operating cost savings are $0.21 million annually, and the payback time is 3.74 years. Additionally, a comprehensive HP ShowCase Tool was developed for evaluating the optimal solution to improve sustainability and decarbonization of the buildings on the ORNL campus. The tool is an Excel-based tool integrated with VBA (Visual Basic for Applications) coding. The tool includes collected ORNL campus building information and an MTHP library, which comprises collected commercial and ORNL-defined MTHPs. The tool was used to evaluate the sustainability and decarbonization of the ORNL campus. The tool can be widely used or referenced for heat pump solutions and building decarbonization renovation strategies to modernize ORNL facilities and energy use–intensive equipment to enable efficient, sustainable, and resilient operations in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Research and development of hydrogen carrier based solutions for hydrogen compression and storage

Industrial and public interest in hydrogen technologies has risen strongly recently, as hydrogen is the ideal means for medium to long term energy storage, transport and usage in combination with renewable and green energy supply. In a future energy system, the production, storage and usage of green hydrogen is a key technology. Hydrogen is and will in future be even more used for industrial production processes as a reduction agent or for the production of synthetic hydrocarbons, especially in the chemical industry and in refineries. Under certain conditions material based systems for hydrogen storage and compression offer advantages over the classical systems based on gaseous or liquid hydrogen. This includes in particular lower maintenance costs, higher reliability and safety. Hydrogen storage is possible at pressures and temperatures much closer to ambient conditions. Hydrogen compression is possible without any moving parts and only by using waste heat. In this paper, we summarize the newest developments of hydrogen carriers for storage and compression and in addition, give an overview of the different research activities in this field.

08 HYDROGEN↗