Search NASA⌕ Search

SEARCH · Search NASA

Results for “Exascale”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Providing Thermal Stability for an Exascale Supercomputer: A Case Study of Frontier's Cooling System

High performance computing (HPC) systems frequently produce large dynamic power swings, even under typical operating conditions, that can present a significant challenge for their direct-liquid cooling systems. Further, the primary cooling loops that must remove this waste heat have response times measured in minutes while the underlying HPC component thermal stress is measured in seconds. The per-socket power demand for both compute processing units (CPUs) and graphic processing units ( GPUs) continues to increase with each successive generation while case temperatures are declining. New HPC systems are expected to exacerbate the challenge of these dynamic power swings and the impact on effective and timely cooling systems. This paper describes the cooling and controls system for Oak Ridge National Laboratory’s Frontier Supercomputer, the first sustained exascale system, as a case study for this situation. The cooling and control system for Frontier demonstrates specific success, but with a number of trade-offs and decisions that suggest further design and operating optimizations for the community at large to consider.

42 ENGINEERING↗
DOE OSTI2024

A multiphysics coupling framework for exascale simulation of fracture evolution in subsurface energy applications

Predicting the evolution of fractured media is challenging due to coupled thermal, hydrological, chemical and mechanical processes that occur over a broad range of spatial scales, from the microscopic pore scale to field scale. We present a software framework and scientific workflow that couples the pore scale flow and reactive transport simulator Chombo-Crunch with the field scale geomechanics solver in GEOS to simulate fracture evolution in subsurface fluid-rock systems. This new multiphysics coupling capability comprises several novel features. An HDF5 data schema for coupling fracture positions between the two codes is employed and leverages the coarse resolution of the GEOS mechanics solver which limits the size of data coupled, and is, thus, not taxed by data resulting from the high resolution pore scale Chombo-Crunch solver. The coupling framework requires tracking of both before and after coarse nodal positions in GEOS as well as the resolved embedded boundary in Chombo-Crunch. We accomplished this by developing an approach to geometry generation that tracks the fracture interface between the two different methodologies. The GEOS quadrilateral mesh is converted to triangles which are organized into bins and an accessible tree structure; the nodes are then mapped to the Chombo representation using a continuous signed distance function that determines locations inside, on and outside of the fracture boundary. The GEOS positions are retained in memory on the Chombo-Crunch side of the coupling. The time stepping cadence for coupled multiphysics processes of flow, transport, reactions and mechanics is stable and demonstrates temporal reach to experimental time scales. The approach is validated by demonstration of 9 days of simulated time of a core flood experiment with fracture aperture evolution due to invasion of carbonated brine in wellbore-cement and sandstone. We also demonstrate usage of exascale computing resources by simulating a high resolution version of the validation problem on OLCF Frontier.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Multiphysics Time-Integration for Turbulent Combustion at the Exascale

Turbulent reacting flow systems are often modeled with coupled time-dependent partial differential equations (PDEs). Solving such equations can easily tax the world's largest supercomputers. One pragmatic strategy for attacking such problems is to split the PDEs into components that can more easily be solved in isolation. This generic operator-splitting strategy leads to a set of ordinary differential equations (ODEs) that need to be solved as part of an "outer-loop" time-stepping approach. In many combustion applications, the ODEs to be solved can be very stiff, exhibiting timescales that span many orders of magnitude. The SUNDIALS library provides a plethora of robust time integration algorithms for solving these ODEs on exascale-capable computing hardware, yet for many complex applications (such multicomponent fuels or emissions predictions), the chemical models remain too complex to solve using reasonable resources. The Quasi-Steady State Approximation (QSSA) can be an effective tool for reducing the size and stiffness of the simulations. In this talk, I will discuss the use of the SUDIALS library of ODE solvers together with automatic code generation tools to solve complex turbulent reacting flow problems using QSSA models.

chemistry↗
DOE OSTI2024

SOMA: Observability, monitoring, and in situ analytics for exascale applications

With the rise of exascale systems and large, data-centric workflows, the need to observe and analyze high performance computing (HPC) applications during their execution is becoming increasingly important. HPC applications are typically not designed with online monitoring in mind, therefore, the observability challenge lies in being able to access and analyze interesting events with low overhead while seamlessly integrating such capabilities into existing and new applications. We explore how our service-based observation, monitoring, and analytics (SOMA) approach to collecting and aggregating both application-specific diagnostic data and performance data addresses these needs. Furthermore, we present our SOMA framework and demonstrate its viability with LULESH, a hydrodynamics proxy application. Then we focus on Astaroth, a multi-GPU library for stencil computations, highlighting the integration of the TAU and APEX performance tools and SOMA for application and performance data monitoring.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Characterizing GPU Energy Usage in Exascale-Ready Portable Science Applications

We characterize the GPU energy usage of two widely adopted exascale-ready applications representing two classes of particle and mesh solvers: (i) QMCPACK, a quantum Monte Carlo package, and (ii) AMReX-Castro, an adaptive mesh astrophysical code. We analyze power, temperature, utilization, and energy traces from double-/single (mixed)-precision benchmarks on NVIDIA’s A100 and H100 and AMD’s MI250X GPUs using queries in NVML and rocm_smi_lib, respectively. We explore application-specific metrics to provide insights on energy vs. performance trade-offs. Our results suggest that mixed-precision energy savings range between 6–25% on QMCPACK and 45% on AMReX-Castro. Also, we found gaps in the AMD tooling used on Frontier GPUs that need to be understood, while query resolutions on NVML have little variability between 1 ms-1 s. Overall, application level knowledge is crucial to define energy-cost/science-benefit opportunities for the codesign of future supercomputer architectures in the post-Moore era.

Godoy, William [ORNL] (ORCID:0000000225905178)↗
DOE OSTI2024

The atmospheric effect of aerosols on future tropical cyclone frequency and precipitation in the Energy Exascale Earth System Model

This study uses experiments from the Energy Exascale Earth System Model (E3SM) to compare the influence on tropical cyclone (TC) activity of: (i) the atmospheric effect of aerosols under specified sea-surface temperatures (SSTs); and (ii) the net effect of greenhouse gases (GhGs) (including changes in SSTs). The experiments were performed using the CMIP6 Shared Socioeconomic Pathway SSP5-8.5 emissions scenario with GhG-induced SST warming specified and atmospheric aerosol effects simulated but without explicit ocean coupling. Insignificant changes in global TC frequency are found in response to the atmospheric effect of future aerosols and GhGs, as significant regional responses in TC frequency counteract each other. Future GhGs contribute to more frequent TCs in the North Atlantic, and reductions over the Northwestern Pacific and Southern Indian Ocean. The atmospheric effect of future aerosols drives more frequent TCs over the Northwestern Pacific and reductions over the Northeast Pacific and North Atlantic. Along with increases in TC intensity, global TC precipitation (TCP) is projected to increase by 52.8% (14.1%/K) due to the combined effect of future aerosols and GhGs. Although both forcings contribute to TCP increases (14.7–19.3% from reduced aerosols alone and 28.1–33.3% from increased GhGs alone), they lead to different responses in the spatial structure of TCP. TCP increases preferentially in the inner-core due to increased GhGs, whereas TCP decreases in the inner-core and increases in the outer-bands in response to the atmospheric effects of decreased aerosols. These changes are distinct from those caused by aerosol-induced SST changes, which have been considered in other studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Development of a River Dynamical Core for E3SM to simulate compound flooding on Exascale-class heterogeneous supercomputers

Flooding events pose significant risk to human life, property, and infrastructure. Physically-consistent quantification of altered flood risks in global models requires hyper-resolution (~1 km) or fine flood simulations using two-dimensional (2D) physics schemes, both of which are unavailable in the current generation Earth System Models. Here, in this work, we have developed the River Dynamical Core (RDycore), which is an open-source, 2D shallow water equation (SWE) library for the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM). RDycore uses PETSc and libCEED libraries that allows it to run efficiently on CPUs and GPUs, as well as select a time-integration algorithm at runtime without requiring any code modifications. RDycore achieves spatial error convergence rates for problems with analytical and manufactured solutions similar to those reported previously in the literature, or consistent with the implemented first-order spatial discretization scheme. RDycore's accuracy in predicting flooding for a well-studied dam break problem is comparable to existing SWE models. For a problem with 471 million grid cells, RDycore achieves a speedup of 6.6x and 7.6x on GPUs compared to CPUs when using 320 compute nodes on DOE's Perlmutter and Frontier supercomputers, respectively. The one-way coupling of the RDycore library within E3SM is demonstrated by performing multiple 5-day flooding simulations during Hurricane Harvey driven by five precipitation datasets. The E3SM--RDycore simulations at 30 m spatial resolution accurately simulate maximum water height during the hurricane when benchmarked against a previously published study and achieve a speedup of 15x (Perlmutter) and 21x (Frontier) on GPUs relative to CPUs. The work presented here is the foundational step in providing hardware and algorithmic portability framework for simulating kilometer-scale river dynamics within E3SM.

Flood Simulation↗
DOE OSTI2025

Mechanisms in Regulating the Quasi‐Biennial Oscillation in Exascale Earth System Model Version 2

Abstract The update to the deep convection parameterization in the energy exascale Earth system model version 2 (E3SMv2) makes the simulated quasi‐biennial oscillation (QBO) have a shorter period than without the update when other tunable parameters the same since the update makes convection more intense but less frequent while leaving the time‐mean convective heating tendency almost unchanged. Amplitudes of momentum fluxes of parameterized gravity waves (GWs) are intensified since they are determined by the square of convective heating tendency. In addition, stronger planetary waves are simulated in E3SMv2 with the convection scheme update, partially due to the tropospheric precipitation change. Furthermore, there is evidence that planetary waves are intensified in the stratosphere due to the dissipation of enhanced parameterized GWs. These factors are found to be responsible for modulating the QBO simulated in E3SMv2.

Li, Yuanpu [Climate and Global Dynamics Division U↗
DOE OSTI2026

Subseasonal Tropical Convection Characteristics in the Energy Exascale Earth System Model Version 2

Accurate simulation of subseasonal tropical moist convection remains a key challenge for Earth system models. The difficulties stem from the reliance of cumulus cloud processes on model parameterizations and the need to represent the multiscale nature of interactions among clouds, radiation, moisture, circulation, and surface energy fluxes. Equatorial convection drives circulation anomalies that can affect weather patterns and extremes globally, motivating efforts to better understand and simulate these tropical disturbances. Here, a detailed review of subseasonal tropical convective behavior as simulated in the Energy Exascale Earth System Model version 2 (E3SMv2) is presented, with comparison to its predecessor version 1 (E3SMv1) and reference data sets. Model structural changes to the deep convective trigger function and surface fluxes, along with parametric tuning of the cloud and microphysics schemes, together result in an improved depiction of organized tropical convection across scales. In particular, E3SMv2 exhibits a more realistic Madden‐Julian oscillation (MJO) and low‐frequency Kelvin waves—owing to a sharper time mean equatorial meridional moisture gradient and improved convection‐circulation coupling —as well as a better depiction of MJO Northern Hemisphere teleconnections. Despite these improvements, subseasonal precipitation variance continues to be strongly underestimated in E3SMv2. Use of a cloud plume model also reveals that the coupling between daily averaged tropical precipitation and lower tropospheric instability in E3SM is inconsistent with observations, a bias that could potentially impact the simulation of intraseasonal disturbances.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Interactive Gas Chemistry for Enhanced Science Capabilities of the Energy Exascale Earth System Model Version 3

Atmospheric chemistry plays a crucial role in Earth system models (ESMs), controlling atmospheric composition and radiative balance; it is highly interactive with the physical climate, biogeochemical cycles, and human systems. However, it often imposes computational challenges in an ESM. Here we develop a full troposphere‐stratosphere interactive chemistry module for the US Department of Energy's Energy Exascale Earth System Model (E3SM). We intentionally build a streamlined module based on E3SM version 2 that interacts with other components and maintains all of major chemical and chemistry‐climate feedbacks. The module incorporates a new, highly efficient tracer advection scheme; linearization of stratospheric chemistry; and abridged tropospheric chemical mechanism with 28 reactive tracers. This new model, E3SM‐chem, can readily perform century‐long climate simulations of ozone, methane, and nitrous oxide based on emission scenarios as well as provide hourly budgets for the gas‐phase radicals that drive aerosol chemistry. We evaluate E3SM‐chem with an atmosphere‐only simulation as in the recent climate model intercomparison project (CMIP6) finding results similar to the other CMIP6 models. For the present‐day, E3SM‐chem matches the standard measurement metrics for stratospheric and tropospheric ozone, surface air quality, other key reactive gases like carbon monoxide, and the methane lifetime. Overall, E3SM‐chem maintains the climate fidelity of the baseline model while adding at most 20% to the computational cost of the atmosphere model. Hence, interactive chemistry can be a default configuration for long climate simulations at resolutions of 1° or finer, which is crucial for producing self‐consistent chemistry‐climate feedbacks that alter the climate system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

The Energy Exascale Earth System Model Version 3: 1. Overview of the Atmospheric Component

This paper describes the atmospheric component of the US Department of Energy's Energy Exascale Earth System Model (E3SM) version 3. Significant updates have been made to the atmospheric physics compared to earlier versions. Specifically, interactive gas chemistry has been implemented, along with improved representations of aerosols and dust emissions. A new stratiform cloud microphysics scheme more physically treats ice processes and aerosol‐cloud interactions. The deep convection parameterization has been largely improved with sophisticated microphysics for convective clouds, making model convection sensitive to large‐scale dynamics, and incorporating the dynamical and physical effects of organized mesoscale convection. Improvements in aerosol wet removal processes and parameter re‐tuning of key aerosol and cloud processes have improved model aerosol radiative forcing. The model's vertical resolution has increased from 72 to 80 layers with the extra eight layers added in the lower stratosphere to better simulate the Quasi‐Biennial Oscillation. These improvements have enhanced E3SM's capability to couple aerosol, chemistry, and biogeochemistry and reduced some long‐standing biases in simulating tropical variability. Compared to its predecessors, the model shows a much stronger signal for the Madden‐Julian Oscillation, Kelvin waves, mixed Rossby‐gravity waves, and eastward inertia‐gravity waves. Aerosol radiative forcing has been considerably reduced and is now better aligned with community best estimates, leading to significantly improved skill in simulating historical temperature records. Its simulated mean‐state climate is largely comparable to E3SMv2, but with some notable degradation in shortwave cloud radiative effect, precipitable water, and surface wind stress, which will be addressed in future updates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Numerical Water Tracers in the Atmospheric Component of the Energy Exascale Earth System Model: Implementation and Changes in Moisture Origin

Numerical water tracers are implemented in the Energy Exascale Earth System Model version 2. Simulations performed with the water‐tag‐enabled model for both pre‐industrial and future greenhouse gas concentrations reveal a marked increase in the role of mid‐latitude and southern subtropical regions as exporters of atmospheric moisture—to the extratropical upper troposphere and the tropical free troposphere. For the latter, the northward shift of the Intertropical Convergence Zone increases cross‐hemispheric transport of subtropical water vapor to the Northern Hemisphere. In the polar regions, most of the lower tropospheric moistening instead arises from increases in local evaporation. These findings illustrate the utility of the water tags, underscore critical changes in global hydrologic cycle, and provide insight into atmospheric dynamics under future climate scenarios. For applications when a global grid is desired, we additionally propose a novel statistical reconstruction, based on copula modeling, of the joint distribution of origin of water vapor, which reduces the number of tracers from order $\mathcal{O}\left({n}^{2}\right)$to order $\mathcal{O}(n)$, substantially ameliorating the considerable computational cost of water tracers. This statistical reconstruction is particularly beneficial to the interpretation of the relationship between latitude and longitude of origin of moisture over the tropical oceans and in the lower troposphere over land.

copula modeling↗
DOE OSTI2026

The Energy Exascale Earth System Model Version 3: 2. Overview of the Coupled System

The Energy Exascale Earth System Model version 3 (E3SMv3) represents the latest advancement in Earth system modeling developed by the U.S. Department of Energy (DOE). Building upon previous versions, E3SMv3 introduces significant updates across its coupled components to enhance capability and improve fidelity. The atmosphere component incorporates advancements in chemistry, aerosol-cloud interactions, convection, and microphysics. The ocean features a new time-stepping scheme and a higher-resolution unstructured mesh with sub-ice-shelf cavities, while the sea ice model integrates advanced snow and ice physics for more realistic cryospheric simulations. The land model introduces prognostic vegetation dynamics and a new sub-grid topographic treatment of solar radiation. A new tri-grid configuration harmonizes the horizontal grids of the land and river components for improved process coupling. It is enabled by a new non-linear remapping between the atmosphere and land. E3SMv3 underwent extensive testing through a comprehensive simulation campaign, including pre-industrial control, idealized CO 2 experiments, and historical simulations spanning 1850–2024. The model demonstrates significant improvements in simulating the evolution of the historical surface temperature, particularly addressing the “pothole cooling” bias in earlier versions. Reduced aerosol-related forcing contributes to more realistic radiative forcing and better alignment with the observational record. Ocean heat content (OHC) and sea ice trends are also improved as a result.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Origin of large variations of current on/off ratio and switching voltage in atomically thin memristors: an exascale ab initio transport study

Nonvolatile resistive switching in two-dimensional monolayers opens a new avenue for high-density memory/computing devices. However, questions remain as to why the current on/off ratio and switching voltage vary significantly among different devices. Here, we simulate electronic transport of large systems consisting of a h-BN monolayer sandwiched by gold electrodes, enabled by an implementation of the nonequilibrium Green’s function method in the exascale density functional theory (DFT) code: Real-space MultiGrid. Systematic calculations reveal that the wide range of on/off ratios is due to variations in interface distances between the electrode and h-BN that significantly modulate their wavefunction overlap. In addition, DFT calculations demonstrate that the energy barrier of a gold atom dissociating from the electrode to h-BN increases dramatically with the interface distance, thereby explaining the strong dependence of the switching voltage on distance. Our work demonstrates the significance of interface distance in governing the current on/off ratio and switching voltage.

Electronic devices↗
DOE OSTI2025

Using multiple high-resolution datasets to benchmark the energy exascale earth system model (E3SM) for renewable resource assessment

The United States is accelerating its shift toward a renewable energy system. However, renewable resources, which harness energy from the Earth system, are susceptible to both present-day climate variability and future climate change. For example, variations in regional climate can alter renewable energy production patterns and site viability. The use of high-resolution climate model projections can therefore facilitate and may be critical to long-term planning of renewable energy investments. However, climate models must first be validated for renewable resource assessment. This research employs multiple high-spatiotemporal-resolution datasets to assess the capability of the Department of Energy’s (DOE) Energy Exascale Earth System Model version 2 North American Regionally Refined Model (E3SMv2-NARRM) for predicting multi-year climatological values of solar and wind energy capacity factors in the continental U.S., with a focus on regional and seasonal variability. Present-day E3SMv2-NARRM simulations are compared with reported utility-scale production data obtained from the Energy Information Administration (EIA). In addition, E3SMv2-NARRM data are evaluated against non-climate benchmark models from the National Renewable Energy Laboratory, including the Wind Integration National Dataset Toolkit and the National Solar Radiation Database (NSRDB), as well as three wind energy datasets from PLUSWIND. Our analysis indicates that solar capacity factors from E3SM closely match those from the NSRDB dataset. However, both datasets tend to overestimate values by 10% in comparison to EIA data. Furthermore, biases in wind capacity factors within E3SM are notably pronounced in the West Coast regions, where the seasonal cycle diverges from EIA data.

Energy forecasting, Capacity factor, Renewable ene↗
DOE OSTI2026

Pixel-Resolved Long-Context Learning for Turbulence at Exascale: Resolving Small-scale Eddies Toward the Viscous Limit

Turbulence plays a crucial role in multiphysics applications, including aerodynamics, fusion, and combustion. Accurately capturing turbulence's multiscale characteristics is essential for reliable predictions of multiphysics interactions, but remains a grand challenge even for exascale supercomputers and advanced deep learning models. The extreme-resolution data required to represent turbulence, ranging from billions to trillions of grid points, pose prohibitive computational costs for models based on architectures like vision transformers. To address this challenge, we introduce a multiscale hierarchical Turbulence Transformer that reduces sequence length from billions to a few millions and a novel RingX sequence parallelism approach that enables scalable long-context learning. We perform scaling and science runs on the Frontier supercomputer. Our approach demonstrates excellent performance up to 1.1 EFLOPS on 32,768 AMD GPUs, with a scaling efficiency of 94\%. To our knowledge, this is the first AI model for turbulence that can capture small-scale eddies down to the dissipative range in three-dimensional turbulence at high Reynolds numbers.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2025

The Persistent Challenge of Data Locality in the Post-Exascale Era

The era of exascale computing, exemplified by systems like Frontier achieving exaflop-level performance, marks a milestone. However, the quest for sheer compute power leads to strong imbalance in system design. Hence, scaling advancements in memory, network bandwidth, and storage are also necessary and pose challenges, with a crucial need to address data locality issues. This article underscores the fundamental importance of data locality as a key abstraction for optimizing application performance. Despite notable software solutions, the growing complexity of parallelism and memory hierarchy demands performance-portable data locality solutions across diverse computing platforms. Additionally, the article revisits data locality aspects, covering hardware considerations, application perspectives, software stack abstractions, and tool support. It concludes with insights into data locality challenges and opportunities, emphasizing the ongoing significance of collaborative research for progress in this critical issue.

Unat, Didem [Koc University, Istanbul (Turkey)] (O↗
DOE OSTI2024

A Digital Twin Framework for Liquid-cooled Supercomputers as Demonstrated at Exascale

We present ExaDigiT, an open-source framework for developing comprehensive digital twins of liquid-cooled supercomputers. It integrates three main modules: (1) a resource allocator and power simulator, (2) a transient thermo-fluidic cooling model, and (3) an augmented reality model of the supercomputer and central energy plant. The framework enables the study of "what-if" scenarios, system optimizations, and virtual prototyping of future systems. Using Frontier as a case study, we demonstrate the framework's capabilities by replaying six months of system telemetry for systematic verification and validation. Such a comprehensive analysis of a liquid-cooled exascale supercomputer is the first of its kind. ExaDigiT elucidates complex transient cooling system dynamics, runs synthetic or real workloads, and predicts energy losses due to rectification and voltage conversion. Throughout our paper, we present lessons learned to benefit HPC practitioners developing similar digital twins. We envision the digital twin will be a key enabler for sustainable, energy-efficient supercomputing.

Brewer, Wes↗