Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Generating Billion-Edge Scale-Free Networks in Seconds: Performance Study of a Novel GPU-based Preferential Attachment Model

A novel parallel algorithm is presented for generating random scale-free networks using the preferential-attachment model. The algorithm, named cuPPA, is custom-designed for single instruction multiple data (SIMD) style of parallel processing supported by modern processors such as graphical processing units (GPUs). To the best of our knowledge, our algorithm is the first to exploit GPUs, and also the fastest implementation available today, to generate scale free networks using the preferential attachment model. A detailed performance study is presented to understand the scalability and runtime characteristics of the cuPPA algorithm. In one of the best cases, when executed on an NVidia GeForce 1080 GPU, cuPPA generates a scale free network of a billion edges in less than 2 seconds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2026

CORE-BFS: Communication-Optimized REctangular-partitioned BFS Achieving 160.845 TeraTEPS on Frontier Supercomputer

Distributed Breadth-First Search (BFS) is fundamental to many large-scale graph applications, but its performance on parallel systems is often limited by high communication overhead. This paper presents CORE-BFS, an extremely scalable GPU-based BFS implementation that introduces a unique rectangular 2D partitioning-based design for Frontier supercomputer. To further improve performance, we propose four key optimizations: (1) Rectangular 2D-partition specific data formats that use two compressed row and one compressed column status array bitmaps combined with a Double Compressed Sparse Row (DCSR) format per partition, reducing memory footprint and inter-rank traffic; (2) Adaptive frontier & communication strategy that unifies top-down and bottom-up traversal on the rectangular layout, uses lazy synchronization in top-down levels, and switches variants based on frontier size to minimize communication overhead; (3) Frontier-split degree-aware update that maps frontier vertices to thread-centric, wavefront-centric, and block-centric kernels based on their degree to improve GPU utilization and memory coalescing; (4) Row-reduction pipeline that overlaps bottom-up adjacency list processing with row-wise bitmap reduction to hide inter-rank latency. Together, these techniques increase parallelism while reducing memory and communication overhead. On the Graph500 benchmark, CORE - BFS scales up to 9,248 Frontier nodes with scale-42 graphs and reaches 160.845 TTEPS, delivering a 5.42 × speedup over our previous Frontier implementation.

Yang, Haoshen [Rutgers University]↗
DOE OSTI2020

Portable interactive visualization of large-scale simulations in geotechnical engineering using Unity3D

Development in large-scale geotechnical engineering simulation places tremendous demand for efficient visualization of such simulation data. This study presents a lightweight software tool, i.e. Geotechnical Interactive Visualization (GIV), as a solution to this challenge, which achieves efficient interactive visualization of large-scale simulations data in geotechnical engineering. Visualization data flow and algorithms specifically optimized for common geotechnical engineering applications are implemented in GIV. GIV can visualize geotechnical structure models with time-varying attributes attached to mesh with fixed topology, and also models with time-varying mesh topologies but no attributes attached, the two most common visualization tasks in geotechnical engineering. Furthermore, challenges for large-scale simulation data visualization, including parallel simulation data redundancy, massive data size, dynamic user interaction, and portability are overcome via specifically designed algorithms for simulation data preprocessing and optimized visualization modules using the powerful 3D rendering and interactive game engine Unity3D. Comparison of GIV with several widely used visualization tools for the visualization of large-scale idealized datasets and realistic geotechnical simulations highlights the visualization efficiency, smooth interactivity, and lightweight features of GIV.

42 ENGINEERING↗
DOE OSTI2020

Dynamic Equivalence of Large-Scale Power Systems Based on Boundary Measurements

Parallel computing helped speed up many tasks that can be done independently. The advance in gaming industry did not produce a technology that helps the power industry to reduce the computation time for dynamic simulation in individual cases. To perform faster than real-time simulation for the purpose of predicting power system dynamic trajectory, power industry continues to struggle to reduce the system size and simulation time of large-scale power systems while keeping its dynamic behavior under various disturbances. There is also an acute need for real-time dynamic model reduction as more renewables enter the generation mix with dramatic changes in the generation outputs. All existing model reduction solutions are based on having access to a detailed dynamic model of the system. The system changes by the minutes, dynamic models are only updated annually. To solve this problem, wide-area measurements obtained by the phasor measurement unit (PMU) at the boundaries between the reduced system and the study system is used to represent the external area. An artificial neuro-fuzzy inference system (ANFIS) is established to perform the mapping of the measurement to the external equivalent model. Here the external area is regarded as a black-box. Model reduction studies are conducted on the Northeast Power Coordinating Council (NPCC) under various types of contingencies, by using a co-simulation approach between PSS/E and MATLAB. The results look very promising and will be discussed in this paper.

Tong, Ning↗
DOE OSTI2024

SPARC-X: Quantum simulations at extreme scale - reactive dynamics from first principles

We have developed the massively parallel electronic structure code SPARC-X: a computational framework for performing Kohn-Sham Density Functional Theory (DFT) calculations that can scale linearly with the number of atoms in the system, while being able to leverage petascale and emerging exascale parallel computers to study chemical phenomena at unprecedented length and time scales. SPARC-X exploits a recent breakthrough in electronic structure methodologies: systematically improvable, strictly local, orthonormal, discontinuous real-space bases that efficiently and systematically capture the local chemistry of the system. With further adaptation using new machine-learning techniques and the use of the massively parallel Spectral Quadrature (SQ) electronic structure method, the algorithmic complexity and prefactor associated with DFT calculations involving semilocal as well as hybrid functionals are dramatically reduced. Using petascale computational resources, SPARC-X enables quantum mechanical simulations at length and time scales previously accessible only by empirical approaches, e.g., 1,000,000 atoms for a few picoseconds using semilocal functionals or 1,000 atoms for a few picoseconds using hybrid functionals. Using exascale resources, the sizes and times targeted are two orders of magnitude larger. Such a capability has applications in a wide variety of chemical sciences, including reactive interfaces where large length- and/or long time-scales are needed and traditional force fields fail. This is particularly important in dynamic catalysis, where bond breaking and formation must be understood in detail. We developed, tested, and employed the SPARC-X framework to understand the photocatalytic properties of TiO 2 nanoparticles, revealing finite size effects that cannot be captured with standard model systems or functionals. This integrated development and application strategy ensures that SPARC-X remains a robust, efficient, and scalable software package for quantum simulations on current petascale and emerging exascale computing resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Turbulence driven widening of the near-SOL power width in ASDEX Upgrade H-Mode discharges

Divertor heat flux data from infra red (IR) from various tokamaks in H-Mode regime show that the power width, $\lambda_{q}$, scales approximately like 1.6 $(R/a) ρ_{s,pol}$. However, the IR based scaling comes with the restriction that only discharges were considered with attached divertor conditions. Here we set up a new data base covering low edge density data but also including high density plasmas reaching the H-mode density limit. We use Thomson-scattering to measure the electron temperature decay length which will set the near-SOL power width through parallel heat conduction. We present scaling results for the density, temperature and pressure separatrix fall-off lengths. As the principal result we derive a generalized power width scaling which reads as $\lambda_{q}\propto\,\rho_{s,pol}\cdot(1+2.1\alpha_{t}^{1.7})$ where $\alpha_{t}$ describes a normalized collisionality ($\alpha_{t} = 3\cdot\,10^{-18}\,R\,q^2\,n\,Z_{eff}T^{-2}$). The parameter $\alpha_{t}$ describes the relative importance of the interchange effect on drift-wave turbulence as proposed by Scott and is found to be closely linked to the diamagnetic parameter αd introduced by Rogers, Drake and Zeiler (RDZ). The edge operational space for ASDEX Upgrade displays a boundary qualitatively in agreement with the region labelled as density limit in the edge plasma phase space proposed by RDZ. The data base shows in the limit of low edge densities ($\alpha_{t}\simeq\,0.2$) accurate agreement to the IR based power width scaling. At elevated separatrix densities ($\alpha_{t}\simeq\,1$) the power width is broadened by a factor of up to about three accompanied by a reduction of the $\text{H}_{98,y2}$ confinement factor. Finally, plasmas with higher triangularity show higher values for $\text{H}_{98,y2}$ in the same range of normalized collisionality.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Influence of Vane Trailing Edge Flow on the Formation of Cavity Cells and Rim Sealing

Abstract Hot gas ingestion into the turbine rim seal cavity is an important concern for engine designers. To prevent ingestion, rim seals use high-pressure purge flow; however, the penalty is that excessive use of the purge flow decreases engine thermal efficiency. In this paper, a one-stage turbine operating at engine-representative conditions was used to study the effect of steady and time-resolved under-platform cavity temperatures and pressures across a range of coolant flowrates in the presence of vane trailing edge (VTE) flow. This study correlates time-resolved pressure with time-resolved temperature to identify primary frequencies driving ingestion. At certain flowrates, the time-resolved pressures are out of phase with the temperatures, indicating ingestion. Measurements from high-frequency response pressure sensors in the rim seal and vane platform were also used to determine rotational speed and quantity of large-scale structures (cells). In a parallel effort, a computational model using Unsteady Reynolds-averaged Navier–Stokes (URANS) was applied to determine swirl ratio in the rim seal cavity and time-resolved rim sealing effectiveness. The experimental results confirm that at low purge flowrates, the VTE flow influences the unsteady flow field by decreasing pressure unsteadiness in the rim seal cavity. Results show an increase in purge flow increases the number of unsteady large-scale structures in the rim seal and decreases their rotational speed. However, VTE flow was shown to not significantly change the cell speed and count in the rim seal. Simulations point to the importance of the large-scale cell structures in influencing rim sealing unsteadiness, which is not captured in current rim sealing predictive models.

Engineering↗
DOE OSTI2018

Understanding Soot Development and Thermal Stratification in Combustion Engines through Hyperspectral Non-linear Optical Diagnostics Development

Progress towards next-generation internal combustion engine technologies is dramatically hindered by the complexity of both simulating and measuring key processes, such as thermal stratification and soot formation, in an operating prototype. In general, spectroscopic methods for in-operando probing become limitingly complex at the high pressures and temperature encountered in such systems, and numerical methods for simulating device performance become computationally expensive due to the turbulent flow field, detailed chemistry, and range of important length-scales involved. This report presents parallel experimental and theoretical advances to conquer these limitations. We report the development of high pressure and high temperature ultrafast coherent anti-Stokes Raman spectroscopy measurements, up to a pressure and temperature regime relevant to engine conditions. This report also presents theoretical results using a stochastic one-dimensional turbulence (ODT) model providing insight into the local thermochemical state and its consequences by resolving the full range of reaction-diffusion scales in a stochastic model.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Statistical properties of the population of the Galactic centre filaments – II. The spacing between filaments

ABSTRACT We carry out a population study of magnetized radio filaments in the Galactic centre using MeerKAT data by focusing on the spacing between the filaments that are grouped. The morphology of a sample of 43 groupings containing 174 magnetized radio filaments are presented. Many grouped filaments show harp-like, fragmented cometary tail-like, or loop-like structures in contrast to many straight filaments running mainly perpendicular to the Galactic plane. There are many striking examples of a single filament splitting into two prongs at a junction, suggestive of a flow of plasma along the filaments. Spatial variations in spectral index, brightness, bending, and sharpening along the filaments indicate that they are evolving on a 105−6-yr time-scale. The mean spacings between parallel filaments in a given grouping peaks at ∼16 arcsec. We argue by modeling that the filaments in a grouping all lie on the same plane and that the groupings are isotropically oriented in 3D space. One candidate for the origin of filamentation is interaction with an obstacle, which could be a compact radio source, before a filament splits and bends into multiple filaments. In this picture, the obstacle or sets the length scale of the separation between the filaments. Another possibility is synchrotron cooling instability occurring in cometary tails formed as a result of the interaction of cosmic ray driven Galactic centre outflow with obstacles such as stellar winds. In this picture, the mean spacing and the mean width of the filaments are expected to be a fraction of a parsec, consistent with observed spacing.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Diving into Petascale Production File Systems through Large Scale Profiling and Analysis

As leadership computing facilities grow their storage capacity into the multi- petabyte range, the number of files and directories leap into the scale of billions. A complete profiling of such a parallel file system in a production environment presents a unique challenge. On one hand, the time, resources, and negative performance impact on production users can make regular profiling difficult. On the other hand, the result of such profiling can yield much needed understanding of the file system's general characteristics, as well as provide insight to how users write and access their data on a grand scale. This paper presents a lightweight and scalable profiling solution that can efficiently walk, analyze, and profile multi-petabyte parallel file systems. This tool has been deployed and is in regular use on very large-scale production parallel file systems at both Oak Ridge National Lab's Oak Ridge Leadership Facility (OLCF) and Lawrence Livermore National Lab's Livermore Computing (LC) facilities. We present the results of our initial analysis on the data collected from these two large-scale production systems, organized into three use cases: (1) file system snapshot and composition, (2) striping pattern analysis for Lustre, and (3) simulated storage capacity utilization in preparation for future file systems. Our analysis shows that on the OLCF file system, over 96% of user files exhibit the default stripe width, potentially limiting performance on large files by underutilizing storage servers and disks. Our simulated block analysis quantitatively shows the space overhead when doing a forklift system migration. It also reveals that due to the difference in system compositions (OLCF vs. LC), we can achieve better performance and space trade-offs by employing different native file system block sizes.

Wang, Feiyi↗
DOE OSTI2020

The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers

The design and implementation of a new framework for adaptive mesh refinement calculations are described. It is intended primarily for applications in astrophysical fluid dynamics, but its flexible and modular design enables its use for a wide variety of physics. The framework works with both uniform and nonuniform grids in Cartesian and curvilinear coordinate systems. It adopts a dynamic execution model based on a simple design called a "task list" that improves parallel performance by overlapping communication and computation, simplifies the inclusion of a diverse range of physics, and even enables multiphysics models involving different physics in different regions of the calculation. We describe physics modules implemented in this framework for both nonrelativistic and relativistic magnetohydrodynamics (MHD). These modules adopt mature and robust algorithms originally developed for the Athena MHD code and incorporate new extensions: support for curvilinear coordinates, higher-order time integrators, more realistic physics such as a general equation of state, and diffusion terms that can be integrated with super-time-stepping algorithms. The modules show excellent performance and scaling, with well over 80% parallel efficiency on over half a million threads. The source code has been made publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Rapid in situ diversification rates in Rhamnaceae explain the parallel evolution of high diversity in temperate biomes from global to local scales

Summary The macroevolutionary processes that have shaped biodiversity across the temperate realm remain poorly understood and may have resulted from evolutionary dynamics related to diversification rates, dispersal rates, and colonization times, closely coupled with Cenozoic climate change. We integrated phylogenomic, environmental ordination, and macroevolutionary analyses for the cosmopolitan angiosperm family Rhamnaceae to disentangle the evolutionary processes that have contributed to high species diversity within and across temperate biomes. Our results show independent colonization of environmentally similar but geographically separated temperate regions mainly during the Oligocene, consistent with the global expansion of temperate biomes. High global, regional, and local temperate diversity was the result of high in situ diversification rates, rather than high immigration rates or accumulation time, except for Southern China, which was colonized much earlier than the other regions. The relatively common lineage dispersals out of temperate hotspots highlight strong source‐sink dynamics across the cosmopolitan distribution of Rhamnaceae. The proliferation of temperate environments since the Oligocene may have provided the ecological opportunity for rapid in situ diversification of Rhamnaceae across the temperate realm. Our study illustrates the importance of high in situ diversification rates for the establishment of modern temperate biomes and biodiversity hotspots across spatial scales.

Plant Sciences↗
DOE OSTI2020

Divertor heat flux challenge and mitigation in SPARC

Owing to its high magnetic field, high power, and compact size, the SPARC experiment will operate with divertor conditions at or above those expected in reactor-class tokamaks. Power exhaust at this scale remains one of the key challenges for practical fusion energy. Based on empirical scalings, the peak unmitigated divertor parallel heat flux is projected to be greater than 10 GW m -2 . This is nearly an order of magnitude higher than has been demonstrated to date. Furthermore, the divertor parallel Edge-Localized Mode (ELM) energy fluence projections (~11–34 MJ m -2 ) are comparable with those for ITER. However, the relatively short pulse length (~25 s pulse, with a ~10 s flat top) provides the opportunity to consider mitigation schemes unsuited to long-pulse devices including ITER and reactors. The baseline scenario for SPARC employs a ~1 Hz strike point sweep to spread the heat flux over a large divertor target surface area to keep tile surface temperatures within tolerable levels without the use of active divertor cooling systems. In addition, SPARC operation presents a unique opportunity to study divertor heat exhaust mitigation at reactor-level plasma densities and power fluxes. Not only will SPARC test the limits of current experimental scalings and serve for benchmarking theoretical models in reactor regimes, it is also being designed to enable the assessment of long-legged and X-point target advanced divertor magnetic configurations. Experimental results from SPARC will be crucial to reducing risk for a fusion pilot plant divertor design.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks

Large-scale multiphysics simulations are computationally challenging due to the coupling of multiple processes with widely disparate time scales. The advent of exascale computing systems exacerbates these challenges since these systems enable ever-increasing size and complexity. In recent years, there has been renewed interest in developing multirate methods as a means to handle the large range of time scales, as these methods may afford greater accuracy and efficiency than more traditional approaches of using implicit-explicit (IMEX) and low-order operator splitting schemes. However, to date there have been few performance studies that compare different classes of multirate integrators on complex application problems. In this work, we study the performance of several newly developed multirate infinitesimal (MRI) methods, implemented in the SUNDIALS solver package, on two reacting flow model problems built on structured mesh frameworks. The first model revisits prior work on a compressible reacting flow problem with complex chemistry that is implemented using BoxLib but where we now include comparisons between a new explicit MRI scheme with the multirate spectral deferred correction (SDC) methods in the original paper. The second problem uses the same complex chemistry as the first problem, combined with a simplified flow model, but runs at a large spatial scale where explicit methods become infeasible due to stability constraints. Two recently developed IMEX MRI multirate methods are tested. These methods rely on advanced features of the AMReX framework on which the model is built, such as multilevel grids and multilevel preconditioners. The results from these two problems show that MRI multirate methods can offer significant performance benefits on complex multiphysics application problems and that these methods may be combined with advanced spatial discretization to compound the advantages of both.

97 MATHEMATICS AND COMPUTING↗