SEARCH · Search NASA

Results for “heterogeneous architectures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Scoreboard

Emerging HPC machines have given rise to enhanced compute power that far outstrips the machine's ability to save large scale results for post-processing. To combat this, in situ data analysis techniques are slowly being adopted. With in situ data management favoring workflows composed of multiple simulations and analyses connected in transit on heterogeneous machines, scientists and engineers need a tool that enables them to create data extracts, visualizations, and interactively monitor and steer their simulations. Scoreboard Phase II is a next generation analysis software that supports composite in transit workflows on heterogeneous architectures and restores interactivity to in situ data analysis through simulation monitoring and computational steering. Scoreboard provides a simulation dashboard with graphs of metrics over time, controls for setting custom simulation steering parameters, controls for managing the set of data extracts being produced in the simulation, as well as the ability to explore data extracts, all from a web browser. Realizing the vision outlined in this project required research into making a system that integrates end to end from simulations all the way to the user. In situ tools generally suffer from complexity and excessive software dependencies. Scoreboard, by contrast, is easy to build and integrate into simulation codes and it provides first class FORTRAN support. The Scoreboard library is capable of in situ and in transit data analysis that can produce data extracts commonly needed for Computational Fluid Dynamics (CFD) analysis. Simulations can transparently stage data in transit to a Scoreboard Endpoint program, which can accept their data and produce the requested data extracts. This lets simulations return to their work while the Endpoint works on the analysis. Efficiently staging the data at scale was a topic of this research. Scoreboard provides the means to let the user manage data extracts and monitor/steer many simulations from a web browser. This area of the research focused on discovery of in transit network components to expose and control their steering parameters within an interactive browser-based user interface that includes: system topology, gathered metrics, notifications, dynamically-generated steering controls, and exploration of visualization data products.

Whitlock, BradJoseph [Intelligent Light] (00000001↗

DOE OSTI2023

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) [SWR-23-37]

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) is an open-source computational fluid dynamics package powered by the lattice Boltzmann equations and built on AMReX. In the lattice Boltzmann method, local collisions between meso-scale fictitious particles drive the governing equations which enables MARBLES to easily simulate flow around complex and/or moving geometry without the generation of a body-conforming mesh. Using AMReX data structures and operations ensures a high level of computational performance and parallel scaling on heterogenous architectures while also naturally supporting locally enhanced grid resolution and fidelity through automatic mesh refinement. New domains and problem definitions are easily specified through an input file with examples and guidance on all options and variables provided in the MARBLES documentation.

Henry de Frahan, Marc↗

DOE OSTI2020

A Block-Based Triangle Counting Algorithm on Heterogeneous Environments

Triangle counting is a fundamental building block in graph algorithms. In this paper, we propose a block-based triangle counting algorithm to reduce data movement during both sequential and parallel execution. Our block-based formulation makes the algorithm naturally suitable for heterogeneous architectures. The problem of partitioning the adjacency matrix of a graph is well-studied. Our task decomposition goes one step further: it partitions the set of triangles in the graph. By streaming these small tasks to compute resources, we can solve problems that do not fit on a device. We demonstrate the effectiveness of our approach by providing an implementation on a compute node with multiple sockets, cores and GPUs. The current state-of-the-art in triangle enumeration processes the Friendster graph in 2.1 seconds, not including data copy time between CPU and GPU. Using that metric, our approach is 20 percent faster. When copy times are included, our algorithm takes 3.2 seconds. This is 5.6 times faster than the fastest published CPU-only time.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Towards Use of Mixed Precision in ECP Math Libraries [Exascale Computing Project]

The use of multiple types of precision in mathematical software has the potential to increase its performance on new heterogeneous architectures. The xSDK project focuses both on the investigation and development of multiprecision algorithms as well as their inclusion into xSDK member libraries. This report summarizes current efforts on including and/or using mixed precision capabilities in the math libraries Ginkgo, heFFTe, hypre, MAGMA, PETSc/TAO, SLATE, SuperLU, and Trilinos, including KokkosKernels. It contains both numerical results from libraries that already provide mixed precision capabilities, as well as descriptions of the strategies to incorporate multiprecision into established libraries.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Towards Use of Mixed Precision in ECP Math Libraries

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Chromium Tolerant, Highly Active and Stable Electrocatalytic Internal Surface Coating for Cathode of Commercial SOFCs (Final Report)

This project is aimed to develop a chromium (Cr) tolerant, highly active, and stable coating layer on the internal surfaces of the porous composite cathode from commercially available SOFCs. Such coating layer was developed using the additive manufacturing process of Atomic Layer Deposition (ALD) and has been applied on the cathode consisting of either an electronic conductor of LaxSr 1-x MnyO 3-δ (LSM) or mixed ionic and electronic conducting La x Sr 1-x Co y Fe 1-y O 3-δ (LSCF). PI's work has demonstrated that the internal surface of cathode from the commercial cells, can be further tailored using ALD coating to dramatically enhance the cell performance. For instance, ALD layer consisting heterostructured nano composite of nano-Pt and nano-(Mn 0.8 Co 0.2 ) 3 O 4 oxide on the internal surface of porous LSM/YSZ cathode from SOFCs, has resulted in the large reduction of the cell polarizations resistance by up to 53%, and enormous increase of power density over 370%. For the cells with LSCF/Sm 2 O 3 doped CeO 2 (SDC) cathode, the conformal layer of nano-composite consisting of superjacent CoOx and subjacent minimum amount of Pt nano-grains has resulted in the power density enhancement by 126% for the large scale industry tubular cells at 750°C, and both the performance enhancement and nanostructure of the ALD layer are stable over ~ 2000 h continuous operation performed at industry test station. In the meanwhile, those ALD coating layer developed by PI's work is also inherently Cr-tolerant, and could act as physical barrier for preventing Cr diffusion into the cathode backbone, so as to mitigate the Cr poisoning effect on the cathode. In this project, the impact of Cr on the performance of those ALD coated commercial cells has been evaluated. Based on evolution of the cell performance, the ALD coating layer chemistry and ALD coating layer thickness has been optimized to maximize the overall Cr tolerance, cell power density and cell longevity. Different ALD coating has been applied onto the internal surface of LSM/YSZ and LSCF/SDC backbone respectively. The architecture/scaffold structures on the internal surface of different cathode, designed by this project, was catalogued and analyzed using High Resolution Transmission Electron Microscopy (HRTEM), and cell power/durability performance are assured via comprehensive electrochemical performance testing in the industry operation relevant conditions. The impact of the electrochemical operation current density, the water humidity, the cell operation temperature, and cell operation duration on the Cr tolerance of ALD coated cells has been systematically investigated. There is completely different nanostructure degradation mechanisms between LSM and LSCF cells induced by Cr contamination. For the LSCF/SDC baseline cell, With the Cr source, there is no apparent Sr surface segregation phase even for the baseline cell operated for 3000 h at 750 °C. With the Cr source, there is significant amorphous (SrCr)Ox phase accumulated in the original pore region. For the commercial baseline cells, Cr contaminants on the LSM electrode severely impacted the entire cell's electrochemical performance and nanostructure degradation. Those degradations include (1). Peak power density loss of 64 % after 109 h of operation. The dramatic increase in Rp (2). They are cracking at LSM/SSZ interface, LSM grains. SSZ remains intact but with (CrMn)Ox. By contrast, ALD coating (MnCo)Ox/Pt dramatically improves the Cr resistance, as follows (1). ALD-coated cell with a power density is 280-380 % of the baseline cell, depending on the ALD layer thickness. (2). For a cell with a 20 nm thick ALD layer, there is a large performance enhancement (> 200 % power density) induced by ALD coating of Cr-tolerant Mn 0.8 Co 0.2 Ox. (3). For a cell with a 20 nm thick ALD layer, after 168 h at 750 °C power density of the ALD-coated cell is ~ 600% of that baseline cell upon operation with Cr contamination for 109 h. The ALD coating on the internal surface of cathode developed by this project integrated multi-functions. Those multi-functions include (1). Dramatically improving the cell power density for the commercial cells; (2). Dramatically improving contamination resistance of the cathode, for being an excellent protection coating layer sealing off Cr contamination. (3). Dramatically increasing the cell longevity by potentially preventing the microstructure evolution and grain coarsening of the cathode. Overall, this project will provide a simple solution to simultaneously enhance power density and increase the reliability, robustness, and endurance of commercial SOFCs, over the entire operating temperature range of 650-800 °C. For the inherently functional SOFC, the ALD coating of LSM based cathode mitigate the Cr-contamination. Power density of ALD-coated cell is ~ 600% of that baseline cell upon operation with Cr contamination. In addition to SOFCs, the novel on-demand design approach and creation of multifunctional heterogeneous architecture on the electrode surface presented in this work opens further research for their application in other types of fuel cells, batteries, and sensors for which electrochemical reactions on the surface are similarly critical.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Celeritas R&D Report: Accelerating Geant4

Celeritas is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a Graphics Processing Unit (GPU)-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.4, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling straightforward integration of Celeritas into the high energy physics (HEP) experimental frameworks CMSSW and ATLAS FullSimLight. On the Perlmutter supercomputer, Celeritas performs EM physics between 3× and 18× faster using the machine’s Nvidia GPUs compared to using only CPUs, corresponding to an electrical power efficiency up to a factor of 5. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.7–2.2× on GPU and 1.2× on CPU. In a CMS test application using tt¯ events and the prototype Run 4 configuration, compared to Geant4 CPU, Celeritas with a Nvidia A100 improves overall throughput up to a factor of 2.7× but cannot be efficiently shared with more than 8 cores.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Heterogeneous Computing

To leverage the increasing heterogeneity in modern computing resources, Geant4 incorporates advanced software tools and a task-based framework (G4Tasking) that enables efficient parallelism at event, sub-event, and track levels. Ongoing R&D efforts focus on integrating GPUs into high-energy physics (HEP) simulations, including optical photon simulation with Opticks/NVIDIA OptiX, offloading electromagnetic particle transport using G4HepEM/AdePT and Celeritas, and employing advanced surface-based geometry models such as VecGeom2.0 and ORANGE. As Geant4 continues evolving toward high-performance computing (HPC) and heterogeneous architectures, it remains a key tool for large-scale simulations in HEP and beyond.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Porting the WAVEWATCH III (v6.07) wave action source terms to GPU

Abstract. Surface gravity waves play a critical role in several processes, including mixing, coastal inundation, and surface fluxes. Despite the growing literature on the importance of ocean surface waves, wind–wave processes have traditionally been excluded from Earth system models (ESMs) due to the high computational costs of running spectral wave models. The development of the Next Generation Ocean Model for the DOE’s (Department of Energy) E3SM (Energy Exascale Earth System Model) Project partly focuses on the inclusion of a wave model, WAVEWATCH III (WW3), into E3SM. WW3, which was originally developed for operational wave forecasting, needs to be computationally less expensive before it can be integrated into ESMs. To accomplish this, we take advantage of heterogeneous architectures at DOE leadership computing facilities and the increasing computing power of general-purpose graphics processing units (GPUs). This paper identifies the wave action source terms, W3SRCEMD, as the most computationally intensive module in WW3 and then accelerates them via GPU. Our experiments on two computing platforms, Kodiak (P100 GPU and Intel(R) Xeon(R) central processing unit, CPU, E5-2695 v4) and Summit (V100 GPU and IBM POWER9 CPU) show respective average speedups of 2× and 4× when mapping one Message Passing Interface (MPI) per GPU. An average speedup of 1.4× was achieved using all 42 CPU cores and 6 GPUs on a Summit node (with 7 MPI ranks per GPU). However, the GPU speedup over the 42 CPU cores remains relatively unchanged (∼ 1.3×) even when using 4 MPI ranks per GPU (24 ranks in total) and 3 MPI ranks per GPU (18 ranks in total). This corresponds to a 35 %–40 % decrease in both simulation time and usage of resources. Due to too many local scalars and arrays in the W3SRCEMD subroutine and the huge WW3 memory requirement, GPU performance is currently limited by the data transfer bandwidth between the CPU and the GPU. Ideally, OpenACC routine directives could be used to further improve performance. However, W3SRCEMD would require significant code refactoring to make this possible. We also discuss how the trade-off between the occupancy, register, and latency affects the GPU performance of WW3.

58 GEOSCIENCES↗

DOE OSTI2024

Advanced Computing Annual Report 2023

In 2023, advanced computing saw the arrival of Kestrel, the National Renewable Energy Laboratory's (NREL's) newest high-performance computing (HPC) system. Kestrel will accelerate clean energy research at a pace and scale more than five times greater than Eagle, with approximately 44 petaflops of computing power. Kestrel's heterogeneous architecture - which includes both CPU-only and GPU-accelerated nodes - is designed to bring a much greater GPU capacity to EERE workloads compared to Eagle, enabling rapidly advancing applications in artificial intelligence and expanding research in new directions for computing. In Fiscal Year (FY) 2023, 333 projects utilized NREL's HPC system, advancing the U.S. Department of Energy's (DOE's) Office of Energy Efficiency and Renewable Energy (EERE) mission across 13 funding areas. Cross-disciplinary collaboration among researchers yielded more than 800 technical outputs, including 177 peer-reviewed journal articles in FY 2023. All this great work continues to advance the science of energy efficiency and renewable energy. This report highlights research that utilized HPC resources in FY 2023.

advanced computing↗

DOE OSTI2020

Performance Evaluation of a Two-Dimensional Flood Model on Heterogeneous High-Performance Computing Architectures

This paper describes the implementation of a two-dimensional hydrodynamic flood model with two different numerical schemes on heterogeneous high-performance computing architectures. Both schemes were able to solve the nonlinear hyperbolic shallow water equations using an explicit upwind first-order approach on finite differences and finite volumes, respectively, and were conducted using MPI and CUDA. Four different test cases were simulated on the Summit supercomputer at Oak Ridge National Laboratory. Both numerical schemes scaled up to 128 nodes (768 GPUs) with a maximum 98.2x speedup of over 1 GPU. The lowest run time for the 10 day Hurricane Harvey event simulation at 5 meter resolution (272 million grid cells) was 50 minutes. GPUDirect communication proved to be more convenient than the standard communication strategy. Both strong and weak scaling are shown.

Sharif, Md Bulbul↗

DOE OSTI2023

Analysis of a Runtime Data Sharing Architecture over LTE for a Heterogeneous CAV Fleet

This paper describes a lightweight runtime architecture for telemetry, communication, and control of cars deployed with advanced driver assistance systems where a human is in the loop with the car, via an LTE connection. The system architecture supports both local control decisions based on car sensors and safety algorithms as well as high-level input from external systems that may provide insight into traffic state ahead of sensor data. Implementation of the architecture is done in ROS and depends on open-source software packages for runtime decoding of information from the vehicle’s controller area network (CAN) and integration of GPS data from accompanying sensors. The contribution of the paper is to describe the overall architecture, the data it can communicate to other systems, performance of the system at runtime, and challenges faced when deploying the architecture across a heterogeneous fleet. Preliminary results from analysis of test data will provide insights into whether the use of high-latency communication can be effective for societal-scale intelligent transportation systems when applied in future scenarios

Richardson, Alex↗

DOE OSTI2023

Soil architecture and subsurface stratigraphic heterogeneities across land-lake interfaces along Lake Erie.

Uploaded raw datasets from electrical resistivity tomography (ERT), ground penetrating radar (GPR), electromagnetic induction (EMI) and insitu sensors were acquired across land-lake interfaces along Lake Erie. These datasets were useful to delineate the soil architecture and subsurface stratigraphic heterogeneities. We combined multiple geophysical methods with lithostratigraphic logs from borehole cores and data from soil and borehole sensors to investigate spatial heterogeneities across land-lake interfaces. The apparent electrical conductivity (Eca) maps matched closely with the soil maps from public database and also detected additional soil units that were missing in the traditional soil maps. This implies that electromagnetic induction (EMI) could be relied upon for non invasive characterization of soils in sampling restricted sites where only non-invasive measurements are feasible. Results from electrical resistivity tomography (ERT) and Ground penetrating radar (GPR) are consistent with the surficial geology of the study area, and revealed that the vertical variabilities at the sites are mainly driven by stratigraphy.The ERT data (.stg) were acquired from three different sites portage river (PTR), crane creek (CRC) and old woman creek (OWC). The ".stg" files can be opened with ERT inversion software such as EarthImager, ResIpy or Res2DInv. The GPR data (.GPZ) were also acquired from the three sites, and the ".GPZ" data files can be opened with EKKO_project 5 software from Sensors & Software Inc., or with any other standard GPR software. The EM data (.csv) were acquired from the three sites while the soil sensor data (.csv) here were acquired only from crane creek site. The ".csv) files can be opened with MS Excel or any other spread sheet software.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

HydraGNN_OPF_GFM_2026 - Ensemble of predictive graph foundation models for power grid applications

This dataset supports research on graph foundation models for optimal power flow (OPF) on electric grids using HydraGNN. It contains heterogeneous graph representations of PGLib-OPF cases spanning systems from 14 to 13,659 buses, together with packed HDF5 datasets for pretraining, feasibility classification, and N-1 contingency analysis. The release includes OPF solution data, downstream fine-tuning datasets, pretrained HeteroSAGE and HeteroHEAT model checkpoints, hyperparameter-optimization summaries across multiple heterogeneous GNN architectures, and aggregated fine-tuning results for sample-efficiency studies. The dataset is designed to enable scalable training, evaluation, and transfer-learning studies for OPF surrogate modeling, including node-level AC-OPF solution prediction, graph-level prediction, feasibility classification, operating-condition generalization, and contingency-response tasks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

The Pele Simulation Suite for Reacting Flows at Exascale

In this work, we present the Pele suite of software tools for compressible and incompressible reacting flows. The Pele suite leverages several different libraries, notably AMReX and SUNDIALS, to achieve performance portability on heterogeneous computing architectures across the supercomputing landscape. The Pele suite is comprised of PeleC, a compressible reacting flow block-structured adaptive mesh refinement solver, PeleLMeX, a low-Mach number reacting flow block-structured adaptive mesh refinement solver, Pele-Physics, a library for transport, thermodynamics, finite rate chemistry, soot, spray and radiation physics. The objective of this paper is (i) to present the code development efforts necessary to achieve highly effective and scalable applications for exascale machines and (ii) to detail the performance results of the Combustion-Pele project applications on Oak Ridge National Laboratory's Frontier. We show good weak and strong scaling results for both PeleC and PeleLMeX up to more than 50 billion cells on more than 4096 Frontier graphics processing unit nodes. We also present a capability demonstration simulation of a dual-fuel pulse compression ignition engine (six adaptive mesh refinement levels, and 60 billion cells or 2.1 trillion degrees of freedom) on Frontier, to date one of the largest simulations performed on the first exascale-class supercomputer.

adaptive mesh refinement↗

DOE OSTI2024

Exploring code portability solutions for HEP with a particle tracking test code

Traditionally, high energy physics (HEP) experiments have relied on x86 CPUs for the majority of their significant computing needs. As the field looks ahead to the next generation of experiments such as DUNE and the High-Luminosity LHC, the computing demands are expected to increase dramatically. To cope with this increase, it will be necessary to take advantage of all available computing resources, including GPUs from different vendors. A broad landscape of code portability tools—including compiler pragma-based approaches, abstraction libraries, and other tools—allow the same source code to run efficiently on multiple architectures. In this paper, we use a test code taken from a HEP tracking algorithm to compare the performance and experience of implementing different portability solutions. While in several cases portable implementations perform close to the reference code version, we find that the performance varies significantly depending on the details of the implementation. Achieving optimal performance is not easy, even for relatively simple applications such as the test codes considered in this work. Several factors can affect the performance, such as the choice of the memory layout, the memory pinning strategy, and the compiler used. The compilers and tools are being actively developed, so future developments may be critical for their deployment in HEP experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Geophysical methods reveal the soil architecture and subsurface stratigraphic heterogeneities across land-lake interfaces along Lake Erie

Abstract Purpose The land-lake interface is a unique zone where terrestrial and aquatic ecosystems meet, forming part of the Earth’s most geochemically and biologically active zones. The unique characteristics of this interface are yet to be properly understood due to the inherently high spatiotemporal variability of subsurface properties, which are difficult to capture with the traditional soil sampling methods. Geophysical methods offer non-invasive techniques to capture variabilities in soil properties at a high resolution across various spatiotemporal scales. Methods We combined electromagnetic induction (EMI), electrical resistivity tomography (ERT), and ground penetrating radar (GPR) with data from soil cores and in situ sensors to investigate hydrostratigraphic heterogeneities across land-lake interfaces along the western basin of Lake Erie. Results EMI revealed high spatial heterogeneities in ECa distribution across the land-lake interfaces, with higher values in the wetland and transition zones compared to the upland zone. Soil ECa maps matched soil maps from a public database with the hydric soil units delineated as high conductivity zones (ECa > 40 mS/m). ERT and GPR showed vertical variation in soil properties with clear stratigraphic boundaries, and correlation of ERT profiles with lithologs from piezometers revealed the stratigraphic units of silt–clay and till sequence down to 3.5 m depth which are consistent with the surficial geology of the study area. Conclusions These results validate the use of multiple geophysical methods for extrapolating soil properties and mapping stratigraphic structures at land-lake interfaces, thereby providing the missing information required to improve the earth system model (ESM) of coastal interfaces.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Quantum State Transfer between Heterogeneous 3D QPUs

We present detailed analyses and microwave simulations of a quantum interconnect architecture that couples two distinct three-dimensional quantum processing units (QPUs): (i) a two-cell superconducting radio-frequency (SRF) cavity coupled to multiple transmon qubits and (ii) a waveguide-based cavity hosting a planar circuit with transmons and resonators. The modules are linked via a low-loss superconducting coaxial cable, which serves as a quantum bus. Finite-element electromagnetic simulations are performed to optimize coupling strengths and mode frequencies for high-fidelity quantum state transfer between cavities. These simulation results provide a comprehensive blueprint for the experimental realization of a flexible quantum interconnect architecture, coupling heterogeneous QPUs.

Yaker, Joey [Fermilab]↗