Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Advanced operator splitting-based semi-implicit spectral method to solve the binary phase-field crystal equations with variable coefficients

We present an efficient method to solve numerically the equations of dissipative dynamics of the binary phase-field crystal model proposed by Elder et al. [K.R. Elder, M. Katakowski, M. Haataja, M. Grant, Phys. Rev. B 75 (2007) 064107] characterized by variable coefficients. Using the operator splitting method, the problem has been decomposed into sub-problems that can be solved more efficiently. A combination of non-trivial splitting with spectral semi-implicit solution leads to sets of algebraic equations of diagonal matrix form. Extensive testing of the method has been carried out to find the optimum balance among errors associated with time integration, spatial discretization, and splitting. We show that our method speeds up the computations by orders of magnitude relative to the conventional explicit finite difference scheme, while the costs of the pointwise implicit solution per timestep remains low. Also we show that due to its numerical dissipation, finite differencing can not compete with spectral differencing in terms of accuracy. In addition, we demonstrate that our method can efficiently be parallelized for distributed memory systems, where an excellent scalability with the number of CPUs is observed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multi-rate time integration on overset meshes

Overset meshes are an effective tool for the computational fluid dynamic simulation of problems with complex geometries or multiscale spatio-temporal features. When the maximum allowable timestep on one or more meshes is significantly smaller than on the remaining meshes, standard explicit time integrators impose inefficiencies for time-accurate calculations by requiring that all meshes advance with the smallest timestep. With the targeted use of multi-rate time integrators, separate meshes can be time-marched at independent rates to avoid wasteful computation while maintaining accuracy and stability. This work applies time-explicit multi-rate integrators to the simulation of the compressible Navier-Stokes equations discretized on overset meshes using summation-by-parts (SBP) operators and simultaneous approximation term (SAT) boundary conditions. We introduce a class of multi-rate Adams-Bashforth (MRAB) schemes that offer significant stability improvements and computational efficiencies for SBP-SAT methods. We present numerical results that confirm the efficacy of MRAB integrators, outline a number of implementation challenges, and demonstrate a reduction in computational cost enabled by MRAB. We also look at the use of our method in the setting of a large-scale distributed-memory parallel implementation where we discuss concerns involving load balancing and communication efficiency.

97 MATHEMATICS AND COMPUTING↗

Scalable Implicit Solvers with Dynamic Mesh Adaptation for a Relativistic Drift-Kinetic Fokker–Planck–Boltzmann Model

In this work we consider a relativistic drift-kinetic model for runaway electrons along with a Fokker–Planck operator for small-angle Coulomb collisions, a radiation damping operator, and a secondary knock-on (Boltzmann) collision source. Here, we develop a new scalable fully implicit solver utilizing finite volume and conservative finite difference schemes and dynamic mesh adaptivity. A new data management framework in the PETSc library based on the p4est library is developed to enable simulations with dynamic adaptive mesh refinement (AMR), distributed memory parallelization, and dynamic load balancing of computational work. This framework and the runaway electron solver building on the framework are able to dynamically capture both bulk Maxwellian at the low-energy region and a runaway tail at the high-energy region. To effectively capture features via the AMR algorithm, a new AMR indicator prediction strategy is proposed that is performed alongside the implicit time evolution of the solution. This strategy is complemented by the introduction of computationally cheap feature-based AMR indicators that are analyzed theoretically. Numerical results quantify the advantages of the prediction strategy in better capturing features compared with nonpredictive strategies; and we demonstrate trade-offs regarding computational costs. The robustness with respect to model parameters, algorithmic scalability, and parallel scalability are demonstrated through several benchmark problems including manufactured solutions and solutions of different physics models. We focus on demonstrating the advantages of using implicit time stepping and AMR for runaway electron simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-GPU immersed boundary method hemodynamics simulations

Large-scale simulations of blood flow that resolve the 3D deformation of each comprising cell are increasingly popular owing to algorithmic developments in conjunction with advances in compute capability. Among different approaches for modeling cell-resolved hemodynamics, fluid structure interaction (FSI) algorithms based on the immersed boundary method are frequently employed for coupling separate solvers for the background fluid and the cells within one framework. GPUs can accelerate these simulations; however, both current pre-exascale and future exascale CPU-GPU heterogeneous systems face communication challenges critical to performance and scalability. In this paper, we describe, to our knowledge, the largest distributed GPU-accelerated FSI simulations of high hematocrit cell-resolved flows with over 17 million red blood cells. We compare scaling on a fat node system with six GPUs per node and on a system with a single GPU per node. Through comparison between the CPU- and GPU-based implementations, we identify the costs of data movement in multiscale multi-grid FSI simulations on heterogeneous systems and show it to be the greatest performance bottleneck on the GPU.

97 MATHEMATICS AND COMPUTING↗

Streaming data analytics via message passing with application to graph algorithms

The need to process streaming data, which arrives continuously at high-volume in real-time, arises in a variety of contexts including data produced by experiments, collections of environmental or network sensors, and running simulations. Streaming data can also be formulated as queries or transactions which operate on a large dynamic data store, e.g. a distributed database. We describe a lightweight, portable framework named PHISH which enables a set of independent processes to compute on a stream of data in a distributed-memory parallel manner. Datums are routed between processes in patterns defined by the application. PHISH can run on top of either message-passing via MPI or sockets via ZMQ. The former means streaming computations can be run on any parallel machine which supports MPI; the latter allows them to run on a heterogeneous, geographically dispersed network of machines. We illustrate how PHISH can support streaming MapReduce operations, and describe streaming versions of three algorithms for large, sparse graph analytics: triangle enumeration, subgraph isomorphism matching, and connected component finding. Lastly, we also provide benchmark timings for MPI versus socket performance of several kernel operations useful in streaming algorithms.

97 MATHEMATICS AND COMPUTING↗

Online multimedia retrieval on CPU–GPU platforms with adaptive work partition

Nearest neighbors search is a core operation found in several online multimedia services. These services have to handle very large databases, while, at the same time, they must minimize the query response times observed by users. This is specially complex because those services deal with fluctuating query workloads (rates). Consequently, they must adapt at run-time to minimize the response times as the load varies. In this paper, we address the aforementioned challenges with a distributed memory parallelization of the product quantization nearest neighbor search, also known as IVFADC, for hybrid CPU–GPU machines. Overall, our parallel IVFADC implements an out-of-GPU memory execution scheme to use the GPU for databases in which the index does not fit in its memory, which is crucial for searching in very large databases. The careful use of CPU and GPU with work stealing led to an average response time reduction of 2.4 as compared to using the GPU only. Also, our approach to adapt the system to fluctuating loads, called Dynamic Query Processing Policy (DQPP), attained a response time reduction of up to 5 vs. the best static (BS) policy for moderate loads. The system has attained high query processing rates and near-linear scalability in all experiments. We have evaluated our system on a machine with up to 256 NVIDIA V100 GPUs processing a database of 256 billion SIFT features vectors.

97 MATHEMATICS AND COMPUTING↗

Scalable self attraction and loading calculations for unstructured ocean tide models

Self attraction and earth-loading effects are important for accurately modeling global tides. A common approach of handling this forcing is to expand mass anomalies into spherical harmonics, which are scaled by load Love numbers to account for elastic earth deformation. We investigate two different approaches to perform these calculations for ocean models that employ unstructured meshes and distributed memory parallelization. The first approach leverages a highly efficient spherical harmonics library, but requires all-to-one and one-to-all communications and interpolation operations between the unstructured and a structured mesh. This approach is compared to a parallel algorithm that computes the spherical harmonic transformations directly on the unstructured mesh with an all-reduce communication. Here, our results show that although the unstructured mesh calculations are more expensive, the scalability of the unstructured mesh approach allows for more efficient spherical harmonics transforms for high-resolution meshes and large processor counts. This methodology enables the efficient inclusion of tidal dynamics large-scale Earth system model simulations.

54 ENVIRONMENTAL SCIENCES↗

Memory access optimization for particle operations in computational fluid dynamics-discrete element method simulations

Computational Fluid Dynamics - Discrete Element Method is used to model gas-solid systems in several applications in energy, pharmaceutical and petrochemical industries. Computational performance bottlenecks often limit the problem sizes that can be simulated at industrial scale. The data structures used to store several millions of particles in such large-scale simulations have a large memory footprint that does not fit into the processor cache hierarchies on current high-performance-computing platforms, leading to reduced computational performance. This paper specifically addresses this aspect of memory access bottlenecks in industrial scale simulations. The use of space-filling curves to improve memory access patterns is described and their impact on computational performance is quantified in both shared and distributed memory parallelization paradigms. The Morton space filling curve applied to uniform grids and k-dimensional tree partitions are used to reorder the particle data-structure thus improving spatial and temporal locality in memory. The performance impact of these techniques when applied to two benchmark problems, namely the homogeneous-cooling-system and a fluidized-bed, are presented. We report these optimization techniques lead to approximately two-fold performance improvement in particle focused operations such as neighbor-list creation and data-exchange, with ~ 1.5 times overall improvement in a fluidization simulation with 1.27 million particles.

97 MATHEMATICS AND COMPUTING↗

Intruder configurations in 29 Ne at the transition into the island of inversion: Detailed structure study of 28 Ne

Detailed γ-ray spectroscopy of the exotic neon isotope 28 Ne has been performed for the first time using the one-neutron removal reaction from 29 Ne on a liquid hydrogen target at 240 MeV/nucleon. Based on an analysis of parallel momentum distributions, a level scheme with spin-parity assignments has been constructed for 28 Ne and the negative-parity states are identified for the first time. The measured partial cross sections and momentum distributions reveal a significant intruder p-wave strength providing evidence of the breakdown of the N=20 and N=28 shell gaps. Only a weak, possible f-wave strength was observed to bound final states. Large-scale shell-model calculations with different effective interactions do not reproduce the large p-wave and small f-wave strength observed experimentally, indicating an ongoing challenge for a complete theoretical description of the transition into the island of inversion along the Ne isotopic chain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Diagnosing collisionless energy transfer using field–particle correlations: gyrokinetic turbulence

Determining the physical mechanisms that extract energy from turbulent fluctuations in weakly collisional magnetized plasmas is necessary for a more complete characterization of the behaviour of a variety of space and astrophysical plasmas. Such a determination is complicated by the complex nature of the turbulence as well as observational constraints, chiefly that in situ measurements of such plasmas are typically only available at a single point in space. Recent work has shown that correlations between electric fields and particle velocity distributions constructed from single-point measurements produce a velocity-dependent signature of the collisionless damping mechanism. We extend this work by constructing field–particle correlations using data sets drawn from single points in strongly driven, turbulent, electromagnetic gyrokinetic simulations to demonstrate that this technique can identify the collisionless mechanisms operating in such systems. The velocity-space structure of the correlation between proton distributions and parallel electric fields agrees with expectations of resonant mechanisms transferring energy collisionlessly in turbulent systems. This work motivates the eventual application of field–particle correlations to spacecraft measurements in the solar wind, with the ultimate goal to determine the physical mechanisms that dissipate magnetized plasma turbulence.

Physics↗

Permutationally Invariant Polynomial Expansions with Unrestricted Complexity

A general strategy is presented for constructing and validating permutationally invariant polynomial (PIP) expansions for chemical systems of any stoichiometry. Demonstrations are made for three categories of gas-phase dynamics and kinetics: collisional energy-transfer trajectories for predicting pressure-dependent kinetics, three-body collisions for describing transient van der Waals adducts relevant to atmospheric chemistry, and nonthermal reactivity via quasiclassical trajectories. In total, 30 systems are considered with up to 15 atoms and 39 degrees of freedom. Permutational invariance is enforced in PIP expansions with as many as 13 million terms and 13 permutationally distinct atom types by taking advantage of petascale computational resources. The quality of the PIP expansions is demonstrated through the systematic convergence of in-sample and out-of-sample errors with respect to both the number of training data and the order of the expansion, and these errors are shown to predict errors in the dynamics for both reactive and nonreactive applications. Here, the parallelized code distributed as part of this work enables the automation of PIP generation for complex systems with multiple channels and flexible user-defined symmetry constraints and for automatically removing unphysical unconnected terms from the basis set expansions, all of which are required for simulating complex reactive systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Potential virus-mediated nitrogen cycling in oxygen-depleted oceanic waters

Viruses play an important role in the ecology and biogeochemistry of marine ecosystems. Beyond mortality and gene transfer, viruses can reprogram microbial metabolism during infection by expressing auxiliary metabolic genes (AMGs) involved in photosynthesis, central carbon metabolism, and nutrient cycling. While previous studies have focused on AMG diversity in the sunlit and dark ocean, less is known about the role of viruses in shaping metabolic networks along redox gradients associated with marine oxygen minimum zones (OMZs). Here, we analyzed relatively quantitative viral metagenomic datasets that profiled the oxygen gradient across Eastern Tropical South Pacific (ETSP) OMZ waters, assessing whether OMZ viruses might impact nitrogen (N) cycling via AMGs. Identified viral genomes encoded six N-cycle AMGs associated with denitrification, nitrification, assimilatory nitrate reduction, and nitrite transport. The majority of these AMGs (80%) were identified in T4-like Myoviridae phages, predicted to infect Cyanobacteria and Proteobacteria, or in unclassified archaeal viruses predicted to infect Thaumarchaeota. Four AMGs were exclusive to anoxic waters and had distributions that paralleled homologous microbial genes. Together, these findings suggest viruses modulate N-cycling processes within the ETSP OMZ and may contribute to nitrogen loss throughout the global oceans thus providing a baseline for their inclusion in the ecosystem and geochemical models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Lower hybrid current drive experiments on Alcator C-Mod: Comparison with theory and simulation

Lower hybrid (LH) current drive experiments have been carried out on the Alcator C-Mod tokamak [I. H. Hutchinson et al., Phys. Plasmas 1, 1511 (1994)] using a radio-frequency system at 4.6 GHz. Up to 900 kW of LH power has been coupled and driven LH currents have been inferred from magnetic measurements by extrapolating to zero loop voltage, yielding an efficiency of n{sub e}I{sub LH}R{sub 0}/P{sub LH}{approx_equal}2.5{+-}0.2x10{sup 19} (A/W/m{sup 2}). We have simulated the LH current drive in these discharges using the combined ray tracing/three-dimensional (r,v{sub perpendicular},v{sub parallel} ) Fokker-Planck code GENRAY-CQL3D (R. W. Harvey and M. McCoy, in Proceedings of the IAEA Technical Committee Meeting on Simulation and Modeling of Thermonuclear Plasmas, Montreal, Canada, 1992) and found similar current drive efficiencies. The simulated profiles of current density from CQL3D, including both ohmic plus LH drive have been found to be in good agreement with the measured current density from a motional Stark effect diagnostic. Measurements of nonthermal x-ray emission confirm the presence of a significant fast electron population and the three-dimensional (r,v{sub perpendicular},v{sub parallel}) electron distribution function from CQL3D has been used in a synthetic diagnostic code to simulate the measured hard x-ray data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Hamiltonian Laceability of some Generalized Honeycomb Tori

Assume that m, n and s are integers with m{>=}2, n{>=}4, 0{<=}s{<=}n and s is of the same parity of m. The generalized honeycomb torus GHT (m,n,s) is recognized as another attractive alternative to existing torus interconnection networks in parallel and distributed applications. It is known that any GHT (m,n,s) is 3-regular, hamiltonian, bipartite graph. We are interested in two special types of the generalized honeycomb torus, GHT (m,n,(n/2)) and GHT (m,n,0). Let G = GHT(m,n,s), where s(set-membership sign){l_brace}(n/2),0{r_brace}. We prove that any G is hamiltonian laceable. More precisely, given a pair of vertices P = {l_brace}u,v|u(set-membership sign)B,v(set-membership sign)W{r_brace} where B and W are the bipartition of V(G), there exists a path Q between u and v such that Q contains all vertices of G.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Cryogenic test of the 4 K / 2 K insert for the ARIEL e-Linac cryomodule

The ARIEL project at TRIUMF requires a 50 MeV superconducting electron linac consisting of five nine cell 1.3 GHz cavities divided into three cryomodules with one, two and two cavities in each module respectively. LHe is distributed in parallel to each module at 4 K and at ∼1.2 bar. Each module has a cryogenic insert on board that receives the 4 K liquid and produces 2 K into a cavity phase separator. The module combines a 4 K phase separator, a plate and fin heat exchanger from DATE and a J-T valve expanding into the 2 K phase separator. The unit also supplies 4 K liquid to thermal intercepts in the module in siphon loops that return the vaporized liquid to the 4 K reservoir. For testing purposes the unit is outfitted with a dummy 2 K phase separator and thermal intercepts with variable heaters that mimic the final heat loads in order to test the cryogenic performance. The design of the 4 K / 2 K insert, the results of the cold tests and a summary of the test infrastructure including cryogenics services will be presented.

43 PARTICLE ACCELERATORS↗

Formation of buffer-gas-trap based positron beams

Presented here are experimental measurements, analytic expressions, and simulation results for pulsed, magnetically guided positron beams formed using a Penning-Malmberg style buffer gas trap. In the relevant limit, particle motion can be separated into motion along the magnetic field and gyro-motion in the plane perpendicular to the field. Analytic expressions are developed which describe the evolution of the beam energy distributions, both parallel and perpendicular to the magnetic field, as the beam propagates through regions of varying magnetic field. Simulations of the beam formation process are presented, with the parameters chosen to accurately replicate experimental conditions. The initial conditions and ejection parameters are varied systematically in both experiment and simulation, allowing the relevant processes involved in beam formation to be explored. These studies provide new insights into the underlying physics, including significant adiabatic cooling, due to the time-dependent beam-formation potential. Methods to improve the beam energy and temporal resolution are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Study of self-consistent particle flows in a plasma blob with particle-in-cell simulations

The self-consistent particle flows in a filamentary coherent structure along the magnetic field line in scrape-off layer (SOL) plasma (plasma blob) have been investigated by means of a three-dimensional electrostatic particle-in-cell simulation code. The presence of the spiral current system composed of the diamagnetic and parallel currents in a blob is confirmed by the particle simulation without any assumed sheath boundary models. Furthermore, the observation of the electron and ion parallel velocity distributions in a blob shows that those distributions are far from Maxwellian due to modification with the sheath formation and that the electron temperature on the higher potential side in a blob is higher than that on the lower potential side. Also, it is found that the ions on the higher potential side are accelerated more intensively along the magnetic field line than those on the lower potential side near the edge. This study indicates that particle simulations are able to provide an exact current closure to analysis of blob dynamics and will bring more accurate prediction of plasma transport in the SOL without any empirical assumptions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗