DOE OSTI · 963934
Tracking Files Using the Kepler Provenance Framework
Abstract
Workflow Management Systems (WFMS), such as Kepler, are prov- ing to be an important tool in scientific problem solving. They can automate and manage complex processes and huge amounts of data produced by petas- cale simulations. Typically, the produced data need to be properly visualized and analyzed by scientists in order to achieve the desired scientific goals. Both run-time and post analysis may benefit from, even require, additional meta-data provenance information. One of the challenges in this context is the tracking of the data files that can be produced in very large numbers during stages of the workflow, such as visualizations. The Kepler provenance framework collects all or part of the raw information flowing through the workflow graph. This infor- mation then needs to be further parsed to extract meta-data of interest. This can be done through add-on tools and algorithms. We show how to automate track- ing specific information such as data files locations.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Mouallem, P. A., Tchoua, Roselyne B, Klasky, Scott A, Podhorszki, Norbert, Vouk, M. A.. 2009-01-01. Tracking Files Using the Kepler Provenance Framework. https://www.osti.gov/biblio/963934
Cite the original work for its findings. Save a collection to share your selection of sources.