DOE OSTI · 973731
Kepler + MeDICi
Abstract
applications are often structured as workflows that execute a series of interdependent, distributed software modules to analyze large data sets. Passing very large data sets between workflow steps can incur unacceptable overheads with workflow engines that are not designed to efficiently handle large data transfers. In this paper, we describe how we have enhanced a Kepler workflow application with the MeDICi Integration Framework, which has been specifically designed to support the execution of data intensive workflows. The MeDICi technology provides a scalable, component-based architecture that efficiently handles integration with heterogeneous, distributed software systems. This paper describes the MeDICi Integration Framework and the mechanisms we used to integrate MeDICi components with Kepler workflow actors. We illustrate this solution with a workflow application for an atmospheric sciences application, which demonstrates the advantages of this approach.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Chase, Jared M, Gorton, Ian, Sivaramakrishnan, Chandrika, Almquist, Justin P, Wynne, Adam S, Chin, George, Critchlow, Terence J. 2009-07-10. Kepler + MeDICi. https://www.osti.gov/biblio/973731
Cite the original work for its findings. Save a collection to share your selection of sources.