Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Total fluid pressure imbalance in the scrape-off layer of tokamak plasmas

Simulations using the fully kinetic neoclassical code XGCa (X-point included guiding-center axisymmetric) were undertaken to explore the impact of kinetic effects on scrape-off layer (SOL) physics in DIII-D H-mode plasmas. XGCa is a total-f, gyrokinetic code which self-consistently calculates the axisymmetric electrostatic potential and plasma dynamics, and includes modules for Monte Carlo neutral transport. Previously presented XGCa results showed several noteworthy features, including large variations of ion density and pressure along field lines in the SOL, experimentally relevant levels of SOL parallel ion flow (Mach number similar to 0.5), skewed ion distributions near the sheath entrance leading to subsonic flow there, and elevated sheath potentials (Churchill 2016 Nucl. Mater. Energy 1-6). In this paper, we explore in detail the question of pressure balance in the SOL, as it was observed in the simulation that there was a large deviation from a simple total pressure balance (the sum of ion and electron static pressure plus ion inertia). It will be shown that both the contributions from the ion viscosity (driven by ion temperature anisotropy) and neutral source terms can be substantial, and should be retained in the parallel momentum equation in the SOL, but still falls short of accounting for the observed fluid pressure imbalance in the XGCa simulation results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance Analysis of an Actor-Based Distributed Simulation

Object-oriented design of simulation programs appears to be very attractive because of the natural association of components in the simulated system with objects. There is great potential in distributing the simulation across several computers for the purpose of parallel computation and its consequent handling of larger problems in less elapsed time. One approach to such a design is to use "actors", that is, active objects with their own thread of control. Because these objects execute concurrently, communication is via messages. This is in contrast to an object-oriented design using passive objects where communication between objects is via method calls (direct calls when they are in the same address space and remote procedure calls when they are in different address spaces or different machines). This paper describes a performance analysis program for the evaluation of a design for distributed simulations based upon actors.

Schoeffler, James D.↗

Molecular Dyhamics Simulation of the Interfacial Behavior of Aqueous Polyelectrolyte Solutions in Contact with Graphene surfaces in the Presence of Multivalent Cations

We present a detailed analysis of the behavior of aqueous electrolyte-polyelectrolyte systems in contact with neutral and charged graphene substrates, based on an extensive molecular dynamics simulation effort. Our study involves aqueous systems comprising short-chains of lithium-polystyrene sulfonate with explicit atomistic description of water, the chain backbones, and their interactions with all species in solution as well as with the graphene surface. We place special emphasis on the behavior of the axial profiles of species concentrations, local electrostatic charge density, electric field and corresponding surface-charge screening to provide a full characterization of the inhomogeneous environment at the solid-liquid interface, i.e., the electric double layer and the effect of the added salts (BaCl2 and LaCl3 ) on its structure. To complete the analysis, we assess the tendency toward ion pairing along planes parallel to the graphene surface and estimate, according to the axial distribution profiles, the strength of the adsorption of the polyelectrolyte, counterions, and other species in solution, in order to interpret the degree of surface-charge screening and the occurrence of surface-charge reversal. We present evidence of a recently reported new phenomenon of overcharging, and discuss the central role of the explicit description of the solvent on this occurrence. Moreover, to interpret the conformational behavior of the polyelectrolyte backbones we determine the axial profiles of the perpendicular and parallel components of the corresponding radius of gyration and end-to-end distance.

36 MATERIALS SCIENCE↗

Parallel replica dynamics method for bistable stochastic reaction networks: Simulation and sensitivity analysis

Stochastic reaction networks that exhibit bistable behavior are common in systems biology, materials science, and catalysis. Sampling of stationary distributions is crucial for understanding and characterizing the long-time dynamics of bistable stochastic dynamical systems. However, simulations are often hindered by the insufficient sampling of rare transitions between the two metastable regions. In this paper, we apply the parallel replica method for a continuous time Markov chain in order to improve sampling of the stationary distribution in bistable stochastic reaction networks. The proposed method uses parallel computing to accelerate the sampling of rare transitions. Furthermore, it can be combined with the path-space information bounds for parametric sensitivity analysis. With the proposed methodology, we study three bistable biological networks: the Schlögl model, the genetic switch network, and the enzymatic futile cycle network. We demonstrate the algorithmic speedup achieved in these numerical benchmarks. More significant acceleration is expected when multi-core or graphics processing unit computer architectures and programming tools such as CUDA are employed

97 MATHEMATICS AND COMPUTING↗

Final Report, Center for Programming Models for Scalable Parallel Computing: Co-Array Fortran, Grant Number DE-FC02-01ER25505

The major accomplishment of this project is the production of CafLib, an 'object-oriented' parallel numerical library written in Co-Array Fortran. CafLib contains distributed objects such as block vectors and block matrices along with procedures, attached to each object, that perform basic linear algebra operations such as matrix multiplication, matrix transpose and LU decomposition. It also contains constructors and destructors for each object that hide the details of data decomposition from the programmer, and it contains collective operations that allow the programmer to calculate global reductions, such as global sums, global minima and global maxima, as well as vector and matrix norms of several kinds. CafLib is designed to be extensible in such a way that programmers can define distributed grid and field objects, based on vector and matrix objects from the library, for finite difference algorithms to solve partial differential equations. A very important extra benefit that resulted from the project is the inclusion of the co-array programming model in the next Fortran standard called Fortran 2008. It is the first parallel programming model ever included as a standard part of the language. Co-arrays will be a supported feature in all Fortran compilers, and the portability provided by standardization will encourage a large number of programmers to adopt it for new parallel application development. The combination of object-oriented programming in Fortran 2003 with co-arrays in Fortran 2008 provides a very powerful programming model for high-performance scientific computing. Additional benefits from the project, beyond the original goal, include a programto provide access to the co-array model through access to the Cray compiler as a resource for teaching and research. Several academics, for the first time, included the co-array model as a topic in their courses on parallel computing. A separate collaborative project with LANL and PNNL showed how to extend the co-array model to other languages in a small experimental version of Co-array Python. Another collaborative project defined a Fortran 95 interface to ARMCI to encourage Fortran programmers to use the one-sided communication model in anticipation of their conversion to the co-array model later. A collaborative project with the Earth Sciences community at NASA Goddard and GFDL experimented with the co-array model within computational kernels related to their climate models, first using CafLib and then extending the co-array model to use design patterns. Future work will build on the design-pattern idea with a redesign of CafLib as a true object-oriented library using Fortran 2003 and as a parallel numerical library using Fortran 2008.

97 MATHEMATICS AND COMPUTING↗

Impact of Inverter-Interfaced Renewable Generation on Transient Stability at Varying Levels of Penetration: Preprint

The transient dynamics of conventional power systems are dominated by synchronous generators, and low-inertia inverters serve as the primary interface between power systems and renewable energy resources. Increasing penetration levels of inverter-interfaced generation are impacting the transient dynamics of power systems. In this paper, we attempt to quantify these impacts at different penetration levels. An elementary system including one inverter, one synchronous generator, and one load is studied under different parameter variations to assess the transient dynamics of the system. To quantify transient stability, the post-fault regions of attraction of the system are estimated by the sample-based basin stability approach with parallel computing technology. The simulation results suggest that different inverter penetration levels, inertias of the generator, inverter controller gains, and phase-locked loop controller gains have a clear impact on the regions of attraction as well as on the transient dynamics of proposed systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evidence of Component Merging Equatorward of the Cusp

The Polar spacecraft passed through a region near the dayside magnetopause on May 29, 1996, at a geocentric distance of approx. 8 R (sub E) and high, northern magnetic latitudes. The interplanetary magnetic field (IMF) was northward during the pass. Data from the Thermal Ion Dynamics Experiment revealed the existence of low-speed (approx. 50 km s (exp-1)) ion D-shaped distributions mixed with cold ions (approx. 2 eV) over a period of 2.5 hours. These ions were traveling parallel to the magnetic field toward the Northern Hemisphere ionosphere and were convecting primarily eastward. The D-shaped distributions are distinct from a convecting Maxwellian and, along with the magnetic field direction, are taken as evidence that the spacecraft was inside the magnetosphere and not in the magnetosheath. Furthermore, the absence of ions in the antiparallel direction is taken as evidence that low-shear merging was occurring at a location southward of the spacecraft and equatorward of the Southern Hemisphere cusp. The cold ions were of ionospheric origin, with initially slow field-aligned speeds, which were accelerated upon reflection from the magnetopause. These observations provide significant new evidence consistent with component magnetic merging sites equatorward of the cusp for northward IMF.

Chandler, M. O.↗

Implementing Molecular Dynamics for Hybrid High Performance Computers - 1. Short Range Forces

The use of accelerators such as general-purpose graphics processing units (GPGPUs) have become popular in scientific computing applications due to their low cost, impressive floating-point capabilities, high memory bandwidth, and low electrical power requirements. Hybrid high performance computers, machines with more than one type of floating-point processor, are now becoming more prevalent due to these advantages. In this work, we discuss several important issues in porting a large molecular dynamics code for use on parallel hybrid machines - 1) choosing a hybrid parallel decomposition that works on central processing units (CPUs) with distributed memory and accelerator cores with shared memory, 2) minimizing the amount of code that must be ported for efficient acceleration, 3) utilizing the available processing power from both many-core CPUs and accelerators, and 4) choosing a programming model for acceleration. We present our solution to each of these issues for short-range force calculation in the molecular dynamics package LAMMPS. We describe algorithms for efficient short range force calculation on hybrid high performance machines. We describe a new approach for dynamic load balancing of work between CPU and accelerator cores. We describe the Geryon library that allows a single code to compile with both CUDA and OpenCL for use on a variety of accelerators. Finally, we present results on a parallel test cluster containing 32 Fermi GPGPUs and 180 CPU cores.

43 PARTICLE ACCELERATORS↗

Domain decomposition approaches for accelerating contour integration eigenvalue solvers for symmetric eigenvalue problems

This work discusses techniques for computing a few selected eigenvalue–eigenvector pairs of large and sparse symmetric matrices. A recently developed class of techniques to solve this type of problems is based on integrating the matrix resolvent operator along a complex contour that encloses the interval containing the eigenvalues of interest. This paper considers such contour integration techniques from a domain decomposition viewpoint and proposes two schemes. The first scheme can be seen as an extension of domain decomposition linear system solvers in the framework of contour integration methods for eigenvalue problems, such as FEAST. The second scheme focuses on integrating the resolvent operator primarily along the interface region defined by adjacent subdomains. A parallel implementation of the proposed schemes is described, and results on distributed computing environments are reported. These results show that domain decomposition approaches can lead to reduced run times and improved scalability.

97 MATHEMATICS AND COMPUTING↗

Evaluation of pre-training large language models on leadership-class supercomputers

Large language models (LLMs) have arisen rapidly to the center stage of artificial intelligence as the foundation models applicable to many downstream learning tasks. However, how to effectively build, train, and serve such models for many high-stake and first-principle-based scientific use cases are both of great interests and of great challenges. Moreover, pre-training LLMs with billions or even trillions of parameters can be prohibitively expensive not just for academic institutions, but also for well-funded industrial and government labs. Furthermore, the energy cost and the environmental impact of developing LLMs must be kept in mind. Here, in this work, we conduct a first-of-its-kind performance analysis to understand the time and energy cost of pre-training LLMs on the Department of Energy (DOE)’s leadership-class supercomputers. Employing state-of-the-art distributed training techniques, we evaluate the computational performance of various parallelization approaches at scale for a range of model sizes, and establish a projection model for the cost of full training. Our findings provide baseline results, best practices, and heuristics for pre-training such large models that should be valuable to HPC community at large. We also offer insights and optimization strategies for using the first exascale computing system, Frontier, to train models of the size of GPT-3 and beyond.

97 MATHEMATICS AND COMPUTING↗

Parallel derivative-free optimization for simulation-based design of behind-the-meter energy systems

In this work, the integrated design and dispatch of behind-the-meter or distributed resources (e.g. stationary battery storage and solar PV generation) is considered. A simulation-based framework is employed, generating high-fidelity results with closed-loop predictive control at a fine resolution, at the expense of high computational cost (several minutes to a few hours per design point). To address this challenge, parallel derivative-free design methods are considered. Four methods are compared, including state-of-the-art surrogate-based methods (Radial-Basis Functions and Gaussian processes) and sampling strategies, an evolutionary-based method, and a simple sequential grid refinement method. As a case study, two types of design problem with increasing complexity are considered, namely, the design of behind-the-meter resources (three design variables) and the inclusion of grid capacity (four design variables). The second yields a constrained design problem for which violations can only be determined after solving the computationally expensive simulation. For the three-dimensional case, all methods present a good performance, achieving a solution within 1% of the optimum after the first iteration, with the sequential grid refinement exhibiting the fastest convergence and achieving the best final objective value. This indicates that the parallel evaluation of multiple sampling points may be more important than the choice of method for small decision spaces. For the four-dimensional constrained case, the Genetic Algorithm presents the best tradeoff between performance and computational effort, while the rough objective function terrain generated by constraint violation penalties reduces the performance of surrogate-based methods. Contour plots with flat regions indicate flexibility in the optimal design and highlight the importance of characterizing the solution space.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Quantum Monte Carlo Endstation for Petascale Computing

The major achievements enabled by QMC Endstation grant include * Performance improvement on clusters of x86 multi-core systems, especially on Cray XT systems * New and improved methods for the wavefunction optimizations * New forms of trial wavefunctions * Implementation of the full application on NVIDIA GPUs using CUDA The scaling studies of QMCPACK on large-scale systems show excellent parallel efficiency up to 216K cores on Jaguarpf (Cray XT5). The GPU implementation shows speedups of 10-15x over the CPU implementation on older generation of x86. We have implemented hybrid OpenMP/MPI scheme in QMC to take advantage of multi-core shared memory processors of petascale systems. Our hybrid scheme has several advantages over the standard MPI-only scheme. * Memory optimized: large read-only data to store one-body orbitals and other shared properties to represent the trial wave function and many-body Hamiltonian can be shared among threads, which reduces the memory footprint of a large-scale problem. * Cache optimized: the data associated with an active Walker are in cache during the compute-intensive drift-diffusion process and the operations on an Walker are optimized for cache reuse. Thread-local objects are used to ensure the data affinity to a thread. * Load balanced: Walkers in an ensemble are evenly distributed among threads and MPI tasks. The two-level parallelism reduces the population imbalance among MPI tasks and reduces the number of point-to-point communications of large messages (serialized objects) for the Walker exchange. * Communication optimized: the communication overhead, especially for the collective operations necessary to determine ET and measure the properties of an ensemble, is significantly lowered by using less MPI tasks. The multiple forms of parallelism afforded by QMC algorithms make them ideal candidates for acceleration in the many-core paradigm. We presented the results of our effort to port the QMCPACK simulation code to the NVIDIA CUDA GPU platform. We restructured the CPU algorithms to express additional parallelism, minimize GPU-CPU communication, and efficiently utilize the GPU memory hierarchy. Using mixed precision on GT200 GPUs and MPI for intercommunication and load balancing, we observe typical full-application speedups of approximately 10x to 15x relative to quad-core Xeon CPUs alone, while reproducing the double-precision CPU results within statistical error. We developed an all-electron quantum Monte Carlo (QMC) method for solids that does not rely on pseudopotentials, and used it to construct a primary ultra-high-pressure calibration based on the equation of state of cubic boron nitride. We computed the static contribution to the free energy with the QMC method and obtained the phonon contribution from density functional theory, yielding a high-accuracy calibration up to 900 GPa usable directly in experiment. We computed the anharmonic Raman frequency shift with QMC simulations as a function of pressure and temperature, allowing optical pressure calibration. In contrast to present experimental approaches, small systematic errors in the theoretical EOS do not increase with pressure, and no extrapolation is needed. This all-electron method is applicable to first-row solids, providing a new reference for ab initio calculations of solids and benchmarks for pseudopotential accuracy. We compared experimental and theoretical results on the momentum distribution and the quasiparticle renormalization factor in sodium. From an x-ray Compton-profile measurement of the valence-electron momentum density, we derived its discontinuity at the Fermi wavevector finding an accurate measure of the renormalization factor that we compared with quantum-Monte-Carlo and G0W0 calculations performed both on crystalline sodium and on the homogeneous electron gas. Our calculated results are in good agreement with the experiment. We have been studying the heat of formation for various Kubas complexes of molecular hydrogen on Ti(1,2)ethylene-nH2 using Diffusion Monte Carlo. This work has been started and is ongoing. We are studying systems involving 1 and 2 Ti bonding sites with up to 10 hydrogen molecules in numerous configurations. This work will establish a benchmark that will test the accuracy of density functional calculations and establish the feasibility of our methods for similar systems.

97 MATHEMATICS AND COMPUTING↗

Mode Multiplexing for Scalable Cavity-Enhanced Operations in Neutral-Atom Arrays

Neutral-atom arrays provide a versatile platform for quantum information processing. However, in large-scale arrays, efficient photon collection remains a bottleneck for key tasks such as fast, nondestructive qubit readout and remote entanglement distribution. We propose a cavity-based approach that enables fast, parallel operations over many atoms using multiple modes of a single optical cavity. By selectively shifting the relevant atomic transitions, each atom can be coupled to a distinct cavity mode, allowing independent simultaneous processing. We present practical system designs that support cavity-mode multiplexing with up to 50 modes, enabling rapid mid-circuit syndrome extraction and significantly enhancing entanglement distribution rates between remote atom arrays. This approach offers a scalable solution to core challenges in neutral-atom arrays, advancing the development of practical quantum technologies.

Aqua, Ziv [Massachusetts Institute of Technology (↗

Simulation of Grazing-Incidence Synchrotron White Beam X-ray Topographic Images of Micropipes in 4H-SiC and Determination of Their Dislocation Senses

Detailed comparison has been drawn between synchrotron white beam X-ray topographic images of micropipes in 4H-SiC, recorded using pyramidal plane reflections in grazing-incidence geometry, and images simulated using the ray-tracing method. The simulations were carried out with and without the influence of surface relaxation effects. The images simulated in the absence of surface relaxation effects appear as white elliptical shaped features, canted to one side or other of the g-vector (depending on the dislocation sense), surrounded by a dark contrast perimeter which thickens at both ends of the major axis and which exhibits two fold symmetry axes parallel to the major and minor axes. On the other hand, on the images simulated taking into account the effects of surface relaxation, the features are again canted to one side or other of the g-vector (depending on the dislocation sense) but do not exhibit the same symmetry in that one of the sides of the oval shape is flattened (along the major axis) and the distribution of intensity around the perimeter no longer possesses the two fold symmetry axes parallel to the major and minor axes. While the details of the distribution of the dark perimeter contrast observed on the recorded images are not so easy to correlate with the simulated distributions, the sense of cant of the roughly elliptical white features on the observed images can be easily correlated with the simulations. Since the sense of cant has the same behavior as a function of dislocation sense for simulations carried out with and without surface relaxation, this provides a high level of confidence that the sense of cant of these features can be readily used to determine the senses of the micropipes.

43 PARTICLE ACCELERATORS↗

Parallel Runtime Interface for Fortran (PRIF): A Multi-Image Solution for LLVM Flang

Fortran compilers that provide support for Fortran’s native parallel features often do so with a runtime library that depends on details of both the compiler implementation and the communication library, while others provide limited or no support at all. This paper introduces a new generalized interface that is both compiler- and runtime-library-agnostic, providing flexibility while fully supporting all of Fortran’s parallel features. The Parallel Runtime Interface for Fortran (PRIF) was developed to be portable across shared- and distributed-memory systems, with varying operating systems, toolchains and architectures. It achieves this by defining a set of Fortran procedures corresponding to each of the parallel features defined in the Fortran standard that may be invoked by a Fortran compiler and implemented by a runtime library. PRIF aims to be used as the solution for LLVM Flang to provide parallel Fortran support. This paper also briefly describes our PRIF prototype implementation: Caffeine.

Bonachea, Dan↗

Distributed computing feasibility in a non-dedicated homogeneous distributed system

The low cost and availability of clusters of workstations have lead researchers to re-explore distributed computing using independent workstations. This approach may provide better cost/performance than tightly coupled multiprocessors. In practice, this approach often utilizes wasted cycles to run parallel jobs. The feasibility of such a non-dedicated parallel processing environment assuming workstation processes have preemptive priority over parallel tasks is addressed. An analytical model is developed to predict parallel job response times. Our model provides insight into how significantly workstation owner interference degrades parallel program performance. A new term task ratio, which relates the parallel task demand to the mean service demand of nonparallel workstation processes, is introduced. It was proposed that task ratio is a useful metric for determining how large the demand of a parallel applications must be in order to make efficient use of a non-dedicated distributed system.

Leutenegger, Scott T.↗

Parallel computing for power system climate resiliency: Solving a large-scale stochastic capacity expansion problem with mpi-sppy

Here we propose a nodal stochastic generation and transmission expansion planning model that incorporates the output from high-resolution global climate models through load and generation availability scenarios. We implement our model in Pyomo and perform computational studies on a realistically-sized test case of the California electric grid in a high performance computing environment. We propose model reformulations and algorithm tuning to efficiently solve this large problem using a variant of the Progressive Hedging Algorithm. We utilize the parallelization capabilities and overall versatility of mpi-sppy, exploiting its hub-and-spoke architecture to concurrently obtain inner and outer bounds on an optimal expansion plan. Initial results show that instances with 360 representative days on a system with over 8,000 buses can be solved to within 5% of optimality in under 4 h of wall clock time, a first step towards solving a large-scale power system expansion planning problem across a wide range of climate-informed operational scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Analysis of liquid-metal-jet impingement cooling in a corner region and for a row of jets

A conformal mapping method was used to analyze liquid-metal-jet impingement heat transfer. The jet flow region and energy equation are transformed to correspond to uniform flow in a parallel plate channel with nonuniform heat addition along a portion of one wall. The exact solution for the wall-temperature distribution was obtained in the transformed channel, and the results are mapped back into the physical plane. Two geometries are analyzed. One is for a single slot jet directed either into an interior corner formed by two flat plates, or over the external sides of the corner; the flat plates are uniformly heated, and the corner can have various included angles. The heat-transfer coefficient at the stagnation point at the apex of the plates is obtained as a function of the corner angle, and temperature distributions are calculated along the heated walls. The second geometry is an infinite row of uniformly spaced parallel slot jets impinging normally against a uniformly heated plate. The heat-transfer behavior is obtained as a function of the spacing between the jets. Results are given for several jet Peclet numbers from 5 to 50.

Siegel, R.↗