DOE OSTI · 1366311
Memory Compression Techniques for Network Address Management in MPI
Abstract
MPI allows applications to treat processes as a logical collection of integer ranks for each MPI communicator, while internally translating these logical ranks into actual network addresses. In current MPI implementations the management and lookup of such network addresses use memory sizes that are proportional to the number of processes in each communicator. In this paper, we propose a new mechanism, called AV-Rankmap, for managing such translation. AV-Rankmap takes advantage of logical patterns in rank-address mapping that most applications naturally tend to have, and it exploits the fact that some parts of network address structures are naturally more performance critical than others. It uses this information to compress the memory used for network address management. We demonstrate that AV-Rankmap can achieve performance similar to or better than that of other MPI implementations while using significantly less memory.
Keep this discovery
Explore connections, maps & timelines
Guo, Yanfei, Archer, Charles J., Blocksome, Michael, Parker, Scott, Bland, Wesley, Raffenetti, Ken, Balaji, Pavan. 2017-05-29. Memory Compression Techniques for Network Address Management in MPI. https://searchnasa.com/record/osti%3A1366311/memory-compression-techniques-for-network-address-management-in-mpi
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.