Search NASA⌕ Search

DOE OSTI · 1001602

A simple, pipelined algorithm for large, irregular all-gather problems.

Abstract

We present and evaluate a new, simple, pipelined algorithm for large, irregular all-gather problems, useful for the implementation of the MPI-Allgatherv collective operation of MPI. The algorithm can be viewed as an adaptation of a linear ring algorithm for regular all-gather problems for single-ported, clustered multiprocessors to the irregular problem. Compared to the standard ring algorithm, whose performance is dominated by the largest data size broadcast by a process (times the number of processes), the performance of the new algorithm depends only on the total amount of data over all processes. The new algorithm has been implemented within different MPI libraries. Benchmark results on NEC SX-8, Linux clusters with InfiniBand and Gigabit Ethernet, Blue Gene/P, and SiCortex systems show huge performance gains in accordance with the expected behavior.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Traff, J L, Ripke, A, Siebert, C, Balaji, P, Thakur, R, Gropp, W. 2008-01-01. A simple, pipelined algorithm for large, irregular all-gather problems.. https://doi.org/10.1007/978-3-540-87475-1_16. https://searchnasa.com/record/osti%3A1001602/a-simple-pipelined-algorithm-for-large-irregular-all-gather-problems

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related reports

Fire Protection Design

The purpose of this project is to design the demolition and installation of a deluge valve swap from a DV-5 to a DV-5A valve.

99 GENERAL AND MISCELLANEOUS↗