DOE OSTI · 1223695
Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information
Abstract
Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Faibish, Sorin, Bent, John M., Tzelnic, Percy, Grider, Gary, Torres, Aaron. 2015-10-20. Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information. https://www.osti.gov/biblio/1223695
Cite the original work for its findings. Save a collection to share your selection of sources.