DOE OSTI · 1013286
Components in the Pipeline
Abstract
Scientists commonly describe their data processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply a sequence of processing steps to transform the data and create useful results. While conceptually simple, pipelines often adopt complex topologies and must meet stringent quality of service requirements that place stress on the software infrastructure used to construct the pipeline. In this paper we describe the MeDICi Integration Framework, which is a component-based framework for constructing complex software pipelines. The framework supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling qualities of service to meet demanding performance, reliability and communication requirements.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Gorton, Ian, Wynne, Adam S, Liu, Yan, Yin, Jian. 2011-02-24. Components in the Pipeline. https://doi.org/10.1109/ms.2011.23
Cite the original work for its findings. Save a collection to share your selection of sources.