DOE OSTI · 985865
Template based parallel checkpointing in a massively parallel computer system
Abstract
A method and apparatus for a template based parallel checkpoint save for a massively parallel super computer system using a parallel variation of the rsync protocol, and network broadcast. In preferred embodiments, the checkpoint data for each node is compared to a template checkpoint file that resides in the storage and that was previously produced. Embodiments herein greatly decrease the amount of data that must be transmitted and stored for faster checkpointing and increased efficiency of the computer system. Embodiments are directed to a parallel computer system with nodes arranged in a cluster with a high speed interconnect that can perform broadcast communication. The checkpoint contains a set of actual small data blocks with their corresponding checksums from all nodes in the system. The data blocks may be compressed using conventional non-lossy data compression algorithms to further reduce the overall checkpoint size.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Archer, Charles Jens, Inglett, Todd Alan. 2009-01-13. Template based parallel checkpointing in a massively parallel computer system. https://www.osti.gov/biblio/985865
Cite the original work for its findings. Save a collection to share your selection of sources.