Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

THEMIS Observations of the Magnetopause Electron Diffusion Region: Large Amplitude Waves and Heated Electrons

We present the first observations of large amplitude waves in a well-defined electron diffusion region based on the criteria described by Scudder et al at the subsolar magnetopause using data from one Time History of Events and Macroscale Interactions during Substorms (THEMIS) satellite. These waves identified as whistler mode waves, electrostatic solitary waves, lower hybrid waves, and electrostatic electron cyclotron waves, are observed in the same 12 s waveform capture and in association with signatures of active magnetic reconnection. The large amplitude waves in the electron diffusion region are coincident with abrupt increases in electron parallel temperature suggesting strong wave heating. The whistler mode waves, which are at the electron scale and which enable us to probe electron dynamics in the diffusion region were analyzed in detail. The energetic electrons (approx. 30 keV) within the electron diffusion region have anisotropic distributions with T(sub e(right angle))/T(sub e(parallel)) > 1 that may provide the free energy for the whistler mode waves. The energetic anisotropic electrons may be produced during the reconnection process. The whistler mode waves propagate away from the center of the "X-line" along magnetic field lines, suggesting that the electron diffusion region is a possible source region of the whistler mode waves.

magnetopause and boundary layers↗

A hybrid parallel framework for the cellular Potts model simulations

The Cellular Potts Model (CPM) has been widely used for biological simulations. However, most current implementations are either sequential or approximated, which can't be used for large scale complex 3D simulation. In this paper we present a hybrid parallel framework for CPM simulations. The time-consuming POE solving, cell division, and cell reaction operation are distributed to clusters using the Message Passing Interface (MPI). The Monte Carlo lattice update is parallelized on shared-memory SMP system using OpenMP. Because the Monte Carlo lattice update is much faster than the POE solving and SMP systems are more and more common, this hybrid approach achieves good performance and high accuracy at the same time. Based on the parallel Cellular Potts Model, we studied the avascular tumor growth using a multiscale model. The application and performance analysis show that the hybrid parallel framework is quite efficient. The hybrid parallel CPM can be used for the large scale simulation ({approx}10{sup 8} sites) of complex collective behavior of numerous cells ({approx}10{sup 6}).

97 MATHEMATICS AND COMPUTING↗

MPI-Bash: Parallel scripting right from the Bourne-Again Shell (Bash)

Parallel, scientific applications running on massively parallel supercomputers commonly produce large numbers of large data files. While parallel filesystems improve the performance of file generation, postprocessing activities such as archiving and compressing the data are often run sequentially (and therefore slowly), squandering the supercomputer's vast performance. Consequently, data that take hours to generate may take days to postprocess. Writing and debugging parallel postprocessing programs is often too time-consuming to be worthwhile, especially for one-off postprocessing operations. What the community needs is a simple mechanism for cobbling together scripts that distribute postprocessing work across a supercomputer's many nodes. MPI-Bash attempts to supply that mechanism by augmenting the GNU project's command shell, Bash, with support for the Message Passing Interface (MPI) and, if available, the Libcircle library for work distribution and load balancing. MPI-Bash makes it easy to parallelize bash scripts that run a set of Linux commands independently over a large number of input files. Because MPI-Bash includes various MPI functions for data transfer and synchronization, it is not limited to embarrassingly parallel workloads but can incorporate phased operations (i.e., all workers must finish operation X before any worker is allowed to begin operation Y).

97 MATHEMATICS AND COMPUTING↗

Wing-Body Aeroelasticity Using Finite-Difference Fluid/Finite-Element Structural Equations on Parallel Computers

In recent years significant advances have been made for parallel computers in both hardware and software. Now parallel computers have become viable tools in computational mechanics. Many application codes developed on conventional computers have been modified to benefit from parallel computers. Significant speedups in some areas have been achieved by parallel computations. For single-discipline use of both fluid dynamics and structural dynamics, computations have been made on wing-body configurations using parallel computers. However, only a limited amount of work has been completed in combining these two disciplines for multidisciplinary applications. The prime reason is the increased level of complication associated with a multidisciplinary approach. In this work, procedures to compute aeroelasticity on parallel computers using direct coupling of fluid and structural equations will be investigated for wing-body configurations. The parallel computer selected for computations is an Intel iPSC/860 computer which is a distributed-memory, multiple-instruction, multiple data (MIMD) computer with 128 processors. In this study, the computational efficiency issues of parallel integration of both fluid and structural equations will be investigated in detail. The fluid and structural domains will be modeled using finite-difference and finite-element approaches, respectively. Results from the parallel computer will be compared with those from the conventional computers using a single processor. This study will provide an efficient computational tool for the aeroelastic analysis of wing-body structures on MIMD type parallel computers.

Byun, Chansup↗

Current distribution on an infinite tubular antenna immersed in a cold collisional magnetoplasma.

Based upon a boundary-value formulation, a new approximate expression is derived for the total axial current on an infinite antenna immersed in an unbounded, cold, collisional magnetoplasma with a dc magnetic field oriented parallel to the antenna. Numerical results are presented for the current distributions over plasma parameters corresponding to each of the eight regions of the Clemmow-Mullaly-Allis diagram and for different values of the collision frequency.

Bhat, B.↗

Scalable Data Management of the Uintah Simulation Framework for Next-Generation Engineering Problems with Radiation

The need to scale next-generation industrial engineering problems to the largest computational platforms presents unique challenges. This paper focuses on data management related problems faced by the Uintah simulation framework at a production scale of 260K processes. Uintah provides a highly scalable asynchronous many-task runtime system, which in this work is used for the modeling of a 1000 megawatt electric (MWe) ultra-supercritical (USC) coal boiler. At 260K processes, we faced both parallel I/O and visualization related challenges, e.g., the default file-per-process I/O approach of Uintah did not scale on Mira. In this paper we present a simple to implement, restructuring based parallel I/O technique. We impose a restructuring step that alters the distribution of data among processes. The goal is to distribute the dataset such that each process holds a larger chunk of data, which is then written to a file independently. This approach finds a middle ground between two of the most common parallel I/O schemes–file per process I/O and shared file I/O–in terms of both the total number of generated files, and the extent of communication involved during the data aggregation phase. To address scalability issues when visualizing the simulation data, we developed a lightweight renderer using OSPRay, which allows scientists to visualize the data interactively at high quality and make production movies. Finally, this work presents a highly efficient and scalable radiation model based on the sweeping method, which significantly outperforms previous approaches in Uintah, like discrete ordinates. The integrated approach allowed the USC boiler problem to run on 260K CPU cores on Mira.

97 MATHEMATICS AND COMPUTING↗

Electromagnetic fluctuations and normal modes of a drifting relativistic plasma

We present an exact calculation of the power spectrum of the electromagnetic fluctuations in a relativistic equilibrium plasma described by Maxwell-Jüttner distribution functions. We consider the cases of wave vectors parallel or normal to the plasma mean velocity. The relative contributions of the subluminal and supraluminal fluctuations are evaluated. Analytical expressions of the spatial fluctuation spectra are derived in each case. These theoretical results are compared to particle-in-cell simulations, showing a good reproduction of the subluminal fluctuation spectra.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Analyzing and visualizing next generation climate data (Final Report)

The project "Analyzing and visualizing next generation climate data" adds block-structured (mosaic) grid support, parallel processing, and 2D/3D curvilinear interpolation to the open-source UV-CDAT climate data analysis tool. Block structured grid support complies to the Gridspec extension submitted to the Climate and Forecast metadata conventions. It contains two parts: aggregation of data spread over multiple mosaic tiles (M-SPEC) and aggregation of temporal data stored in different files (F-SPEC). Together, M-SPEC and F-SPEC allow users to interact with data stored in multiple files as if the data were in a single file. For computational expensive tasks, a flexible, multi-dimensional, multi-type distributed array class allows users to process data in parallel using remote memory access. Both nodal and cell based interpolation is supported; users can choose between different interpolation libraries including ESMF and LibCF depending on the their particular needs.

54 ENVIRONMENTAL SCIENCES↗

Distributed memory, GPU accelerated Fock construction for hybrid, Gaussian basis density functional theory

With the growing reliance of modern supercomputers on accelerator-based architecture such a graphics processing units (GPUs), the development and optimization of electronic structure methods to exploit these massively parallel resources has become a recent priority. While significant strides have been made in the development GPU accelerated, distributed memory algorithms for many modern electronic structure methods, the primary focus of GPU development for Gaussian basis atomic orbital methods has been for shared memory systems with only a handful of examples pursing massive parallelism. Here in this work, we present a set of distributed memory algorithms for the evaluation of the Coulomb and exact exchange matrices for hybrid Kohn–Sham DFT with Gaussian basis sets via direct density-fitted (DF-J-Engine) and seminumerical (sn-K) methods, respectively. The absolute performance and strong scalability of the developed methods are demonstrated on systems ranging from a few hundred to over one thousand atoms using up to 128 NVIDIA A100 GPUs on the Perlmutter supercomputer.

97 MATHEMATICS AND COMPUTING↗

Magnetic field-aligned particle precipitation

Magnetic field-aligned particle fluxes are a common auroral phenomenon. Precipitating field-aligned electrons are seen in the vicinity of auroral arcs as suprathermal bursts, as well as superimposed on the more isotropic inverted V electron precipitation. Electron distribution functions reveal two distinct source populations for the inverted V and field-aligned electron components, and also suggest possible acceleration mechanisms. The inverted V electrons are a hot, boundary plasma sheet population that gains the full parallel acceleration. The field-aligned component appears to originate from cold ionospheric electrons that may be distributed throughout the acceleration region. A turbulent parallel field might explain the apparent lifetime of cold electrons in the acceleration region.

Carlson, C. W.↗

Development of Large-Dimension Configuration-Interaction Shell-Model Code

The project period was devoted to several developments in the technical capabilities of the BIGSTIC large-dimension configuration-interaction shell-model code, written in Fortran 90. The specific computational goals for the project period were: (1) store Lanczos vectors on core in RAM to minimize I/O; (2) rewrite reorthogonalization with Lanczos vectors stored in core, consult with personnel at LLNL, LBL, ORNL, Iowa State University to maximize performance; (3) restrict creation of N-body jumps to those needed by an individual node; and (4) distribute 3-body interaction over many cores. Significant progress was made towards these goals, especially (1) and (2), although in the process they discovered intermediate tasks that had to be accomplished first. The achievements were as follows - I put into place structures and algorithms to facility fragmenting very large-dimension Lanczos intermediate vectors. Only by fragmenting the vectors can we carry out (1) and (2). In addition, I reorganized the action of the Hamiltonian matrix and created a new division of operations for MPI. Based upon earlier work, I made plans of a revised algorithm for distribution of work with MPI, with a particular eye towards breaking up the Lanczos vectors. I introduce a new derived type (opbundles) which collects the parameters for the Hamiltonian, and rewrote the application routines to use it. It has been validated and verified. I made progress towards revised MPI parallelization. Using the opbundles, I was able to compute a distribution of work over compute nodes, which should be very efficient. This new distribution is easier to derive and more efficient, in principle, than the old distribution. Furthermore, it should make applications with fragmented Lanczos vectors easier. Implementation is still in progress.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Study of up–down poloidal density asymmetry of high- $\mathrm{Z}$ impurities with the new impurity version of XGCa

Addition of multispecies impurity ions to the total-f gyrokinetic particle-in-cell code XGCa is reported, including a cross-verification of neoclassical physics against the NEO code. This new version of the neoclassical gyrokinetic code XGCa is used to benchmark and confirm the previous reduced-equation-based prediction that high- $\mathrm{Z}$ impurity particles in the Pfirsch–Schlüter regime can exhibit a significant level of up–down poloidal asymmetry, through the large parallel friction force, and thus influence the radial plasma transport significantly. The study is performed in a plasma with weak toroidal rotation. In comparison, when the impurity particles are in the plateau regime, the up–down poloidal asymmetry becomes weak, with the parallel friction force becoming weaker than the parallel viscous force. It is also found that the linearization of the perturbed distribution function, based on the small poloidal asymmetry assumption, can become invalid. Finally, using the numerical data from XGCa, each term in the parallel fluid force-balance equation have been analysed to find that both the main ions and the electrons respond to the poloidal potential variation adiabatically when the high- $\mathrm{Z}$ tungsten possesses large poloidal variation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Distributed Prognostics based on Structural Model Decomposition

Within systems health management, prognostics focuses on predicting the remaining useful life of a system. In the model-based prognostics paradigm, physics-based models are constructed that describe the operation of a system and how it fails. Such approaches consist of an estimation phase, in which the health state of the system is first identified, and a prediction phase, in which the health state is projected forward in time to determine the end of life. Centralized solutions to these problems are often computationally expensive, do not scale well as the size of the system grows, and introduce a single point of failure. In this paper, we propose a novel distributed model-based prognostics scheme that formally describes how to decompose both the estimation and prediction problems into independent local subproblems whose solutions may be easily composed into a global solution. The decomposition of the prognostics problem is achieved through structural decomposition of the underlying models. The decomposition algorithm creates from the global system model a set of local submodels suitable for prognostics. Independent local estimation and prediction problems are formed based on these local submodels, resulting in a scalable distributed prognostics approach that allows the local subproblems to be solved in parallel, thus offering increases in computational efficiency. Using a centrifugal pump as a case study, we perform a number of simulation-based experiments to demonstrate the distributed approach, compare the performance with a centralized approach, and establish its scalability. Index Terms-model-based prognostics, distributed prognostics, structural model decomposition ABBREVIATIONS

centrifugal pump↗

Quantitative Fluorescence Microscopy To Determine Molecular Occupancy of Phospholipid Vesicles

Encapsulation of molecules in phospholipid vesicles provides unique opportunities to study chemical reactions in small volumes as well as the behavior of individual proteins, enzymes, and ribozymes in a confined region without requiring a tether to immobilize the molecule to a surface. These experiments generally depend on generating a predictable loading of vesicles with small numbers of target molecules and thus raise a significant measurement challenge, namely, to quantify molecular occupancy of vesicles at the single-molecule level. In this work, we describe an imaging experiment to measure the time-dependent fluorescence from individual dye molecules encapsulated in ~130 nm vesicles that are adhered to a glass surface. For determining a fit of the molecular occupancy data to a Poisson model, it is critical to count empty vesicles in the population since these dominate the sample when the mean occupancy is small, λ ≤ ~1. Counting empty vesicles was accomplished by subsequently labeling all the vesicles with a lipophilic dye and reimaging the sample. By counting both the empty vesicles and those containing fluors, and quantifying the number of fluors present, we demonstrate a self-consistent Poisson distribution of molecular occupancy for well-solvated molecules, as well as anomalies due to aggregation of dye, which can arise even at very low solution concentrations. Here, by observation of many vesicles in parallel in an image, this approach provides quantitative information about the distribution of molecular occupancy in a population of vesicles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Overview of the NASA Glenn Flux Reconstruction Based High-Order Unstructured Grid Code

A computational fluid dynamics code based on the flux reconstruction (FR) method is currently being developed at NASA Glenn Research Center to ultimately provide a large- eddy simulation capability that is both accurate and efficient for complex aeropropulsion flows. The FR approach offers a simple and efficient method that is easy to implement and accurate to an arbitrary order on common grid cell geometries. The governing compressible Navier-Stokes equations are discretized in time using various explicit Runge-Kutta schemes, with the default being the 3-stage/3rd-order strong stability preserving scheme. The code is written in modern Fortran (i.e., Fortran 2008) and parallelization is attained through MPI for execution on distributed-memory high-performance computing systems. An h- refinement study of the isentropic Euler vortex problem is able to empirically demonstrate the capability of the FR method to achieve super-accuracy for inviscid flows. Additionally, the code is applied to the Taylor-Green vortex problem, performing numerous implicit large-eddy simulations across a range of grid resolutions and solution orders. The solution found by a pseudo-spectral code is commonly used as a reference solution to this problem, and the FR code is able to reproduce this solution using approximately the same grid resolution. Finally, an examination of the code's performance demonstrates good parallel scaling, as well as an implementation of the FR method with a computational cost/degree- of-freedom/time-step that is essentially independent of the solution order of accuracy for structured geometries.

High-Order Methods↗

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

As large-scale scientific simulations and big data analyses become more popular, it is increasingly more expensive to store huge amounts of raw simulation results to perform post-analysis. To minimize the expensive data I/O, "in-situ" analysis is a promising approach, where data analysis applications analyze the simulation generated data on the fly without storing it first. However, it is challenging to organize, transform, and transport data at scales between two semantically different ecosystems due to the distinct software and hardware difference. To tackle these challenges, we design and implement the X-Composer framework. X-Composer connects cross-ecosystem applications to form an "in-situ" scientific workflow, and provides a unified approach and recipe for supporting such hybrid in-situ workflows on distributed heterogeneous resources. X-Composer reorganizes simulation data as continuous data streams and feeds them seamlessly into the Cloud-based stream processing services to minimize I/O overheads. For evaluation, we use X-Composer to set up and execute a cross-ecosystem workflow, which consists of a parallel Computational Fluid Dynamics simulation running on HPC, and a distributed Dynamic Mode Decomposition analysis application running on Cloud. Our experimental results show that X-Composer can seamlessly couple HPC and Big Data jobs in their own native environments, achieve good scalability, and provide high-fidelity analytics for ongoing simulations in real-time.

Wang, Dali↗

Accelerating the Lagrangian Particle Tracking in Hydrologic Modeling to Continental-Scale

Unprecedented climate change and anthropogenic activities have induced increasing ecohydrological problems, which have motivated the development of large-scale modeling for solutions. Water age/quality is as important as water quantity for understanding the water cycle. However, current scientific progress in tracking water parcels at large-scale with high spatiotemporal resolutions is far behind that in water balance/quantity owing to the lack of powerful tools. EcoSLIM is a particle tracking model that works with the hydrologic model ParFlow-CLM, which couples surface-subsurface hydrology with land surface processes. Here, we demonstrate a parallel framework to accelerate EcoSLIM to continental-scale on a distributed, multi-GPU platform with CUDA-Aware MPI. In tests from catchment-, to regional-, and then to continental-scale using 25-million to 1.6-billion particles, EcoSLIM shows significant speedup and excellent parallel performance. The parallel framework is portable to atmospheric and oceanic particle tracking models, where parallelization is inadequate and a standard parallel framework is absent. Parallelized EcoSLIM is a promising tool to accelerate our understanding of the terrestrial water cycle and the upscaling of subsurface hydrology to Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Automated Instrumentation and Monitoring of Data Movement for Parallel Programs

Writing efficient parallel programs is complicated by the need to select the right data structure alignments and distributions, which determine the nature and volume of inter-processor communications. A large number of performance tools for parallel programs have been developed recently to expose these inter-processor communications. However, none of them support performance views or provide statistics in terms of inter-processor data structure interactions. A performance tool that tracks the interaction between individual data structures and the context of these interactions is essential for understanding the performance of both explicit message passing programs and data-parallel languages such as HPF. In this paper we discuss the use of compiler front end tools for automatically tracking data structure movements in message passing programs, and low-overhead monitoring and postprocessing of such codes. We demonstrate that robust instrumentation and low overhead monitoring of inter-processor data structure movements is possible, with the use of a number of NAS benchmark codes, run on the i860 hypercube. We also show that the data so collected can be used effectively by post processing tools that expose performance bottlenecks using graphical displays and performance statistics.

Sarukkai, Sekhar↗