DOE OSTI · 986715
Scalable Work Stealing
Abstract
Irregular and dynamic parallel applications pose significant challenges to achieving scalable performance on large-scale multicore clusters. These applications often require ongoing, dynamic load balancing in order to maintain efficiency. While effective at small scale, centralized load balancing schemes quickly become a bottleneck on large-scale clusters. Work stealing is a popular approach to distributed dynamic load balancing; however its performance on large-scale clusters is not well understood. Prior work on work stealing has largely focused on shared memory machines. In this work we investigate the design and scalability of work stealing on modern distributed memory systems. We demonstrate high efficiency and low overhead when scaling to 8,192 processors for three benchmark codes: a producer-consumer benchmark, the unbalanced tree search benchmark, and a multiresolution analysis kernel.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Dinan, James S, Larkins, D B, Sadayappan, Ponnuswamy, Krishnamoorthy, Sriram, Nieplocha, Jaroslaw. 2009-11-14. Scalable Work Stealing. https://doi.org/10.1145/1654059.1654113
Cite the original work for its findings. Save a collection to share your selection of sources.