Orchestrating Data-Centric Workflows
- 1 May 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 210-217
- https://doi.org/10.1109/ccgrid.2008.50
Abstract
When orchestrating data-centric workflows as are commonly found in the sciences, centralised servers can become a bottleneck to the performance of a workflow; output from service invocations are normally transferred via a centralised orchestration engine, when they should be passed directly to where they are needed at the next service in the workflow. To address this performance bottleneck, this paper presents a lightweight hybrid workflow architecture and concrete API, based on a centralised control flow, distributed data flow model. Our architecture maintains the robustness and simplicity of centralised orchestration, but facilitates choreography by allowing services to exchange data directly with one another, reducing data that needs to be transferred through a centralised server. Furthermore our architecture is standards compliment, flexible and is a non-disruptive solution; service definitions do not have to be altered prior to enactment.Keywords
This publication has 7 references indexed in Scilit:
- Services Oriented Architecture for Managing Workflows of Avian Flu GridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance Tracking: The CyberShake ExamplePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Decentralized Orchestration of CompositeWeb ServicesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed SystemsScientific Programming, 2005
- Introduction to OGSA-DAI ServicesPublished by Springer Nature ,2005
- GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientistsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Analysis of integration models for service compositionPublished by Association for Computing Machinery (ACM) ,2002