Scalable Grid Application Scheduling via Decoupled Resource Selection and Scheduling
- 1 January 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 568-575
- https://doi.org/10.1109/ccgrid.2006.89
Abstract
Over the past years grid infrastructures have been deployed at larger and larger scales, with envisioned deployments incorporating tens of thousands of resources. Therefore, application scheduling algorithms can become unscalable (albeit polynomial) and thus unusable in large-scale environments. One reason for unscalability is that these algorithms perform implicit resource selection. One can achieve better scalability by performing explicit resource selection independently from scheduling in a "decoupled' approach. Furthermore, we hypothesize that one can achieve similar or even better performance as with the non-decoupled approach, which we call the "one step" approach, by selecting resources judiciously. Leveraging the Virtual Grid abstraction, we demonstrate that the decoupled approach is indeed both scalable and effective in large-scale and highly heterogeneous resource environments.Keywords
This publication has 13 references indexed in Scilit:
- Scheduling strategies for mapping application workflows onto the gridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- The Pegasus portalPublished by Association for Computing Machinery (ACM) ,2005
- Improving parallel data transfer times using predicted variances in shared networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Wide-area communication for grids: an integrated solution to connectivity, performance and security problemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Grid middleware services for virtual data discovery, composition, and integrationPublished by Association for Computing Machinery (ACM) ,2004
- Performance-effective and low-complexity task scheduling for heterogeneous computingIEEE Transactions on Parallel and Distributed Systems, 2002
- The GrADS Project: Software Support for High-Level Grid Application DevelopmentThe International Journal of High Performance Computing Applications, 2001
- EMAN: Semiautomated Software for High-Resolution Single-Particle ReconstructionsJournal of Structural Biology, 1999
- Benchmarking and Comparison of the Task Graph Scheduling AlgorithmsJournal of Parallel and Distributed Computing, 1999
- A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architecturesIEEE Transactions on Parallel and Distributed Systems, 1993