Experiences on adaptive grid scheduling of parameter sweep applications
- 1 January 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10666192,p. 28-33
- https://doi.org/10.1109/empdp.2004.1271423
Abstract
Grids offer a dramatic increase in the number of available compute and storage resources that can be delivered to applications. This new computational infrastructure provides a promising platform to execute loosely coupled, high-throughput parameter sweep applications. This kind of applications arises naturally in many scientific and engineering fields like bioinformatics, computational fluid dynamics (CFD), particle physics, etc. The efficient execution and scheduling of parameter sweep applications is challenging because of the dynamic and heterogeneous nature of grids. We present a scheduling algorithm built on top of the GridWay framework that combines: (i) adaptive scheduling to reflect the dynamic grid characteristics; (ii) adaptive execution to migrate running jobs to better resources and provide fault tolerance; (iii) re-use of common files between tasks to reduce the file transfer overhead. The efficiency of the approach is demonstrated in the execution of a CFD application on a highly heterogeneous research testbed.Keywords
This publication has 11 references indexed in Scilit:
- Experiences on Grid Resource Selection Considering Resource ProximityPublished by Springer Nature ,2004
- Experiences about job migration on a dynamic grid environmentAdvances in Parallel Computing, 2004
- Adaptive computing on the grid using AppLeSIEEE Transactions on Parallel and Distributed Systems, 2003
- A performance oriented migration framework for the gridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Nomadic migration: a new tool for dynamic grid computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Condor-G: a computation management agent for multi-institutional gridsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Heuristics for scheduling parameter sweep applications in grid environmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust Multigrid Algorithms for the Navier–Stokes EquationsJournal of Computational Physics, 2001
- The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid EnvironmentThe International Journal of High Performance Computing Applications, 2001
- Nimrod/G: an architecture for a resource management and scheduling system in a global computational gridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000