DOE OSTI · 1050631
When Workflow Management Systems and Logging Systems Meet: Analyzing Large-Scale Execution Traces
Abstract
This poster shows the benefits of integrating a workflow management system with logging and log mining capabilities. By combing two existing, mature technologies: Pegasus-WMS and Netlogger, we are able to efficiently process execution logs of earthquake science workflows consisting of hundreds of thousands to one million tasks. In particular we show results of processing logs of CyberShake, a workflow application running on the TeraGrid. Client-side tools allow scientists to quickly gather statistics about a workflow run and find out which tasks executed, where they were executed, what was their runtime, etc. These statistics can be used to understand the performance characteristics of a workflow and help tune the execution parameters of the workflow management system. This poster shows the scalability of the system presenting results of uploading task execution records into the system and by showing results of querying the system for overall workflow performance information.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Gunter, Daniel. 2008-07-31. When Workflow Management Systems and Logging Systems Meet: Analyzing Large-Scale Execution Traces. https://searchnasa.com/record/osti%3A1050631/when-workflow-management-systems-and-logging-systems-meet-analyzing-large-scale-execution-traces
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.