Assessment and enhancement of meta-schedulers for multi-site job sharing
- 24 October 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Meta-schedulers such as the LSF MultiCluster scheduler and the Moab meta-scheduler (Silver) are being deployed on clusters interconnected over the grid. A primary goal of such meta-schedulers is to share jobs amongst the individual local sites, balancing the load and improving utilization and turnaround time. This work focuses on current methodologies used in implemented meta-schedulers, such as LSF MultiCluster and Silver. The benefits and disadvantages of both centralized and delegated modes are evaluated. Focusing on the negative impact of meta-schedulers to jobs originating from lightly loaded sites, enhancements are proposed and evaluated via trace-driven simulation. It is shown that it is feasible to reduce the detrimental impact on lightly loaded sites while maintaining excellent overall performance.Keywords
This publication has 9 references indexed in Scilit:
- Bandwidth-aware co-allocating meta-schedulers for mini-grid architecturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- On fairness in distributed job scheduling across multiple sitesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Flexible coscheduling: mitigating load imbalance and improving utilization of heterogeneous resourcesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Distributed job scheduling on computational Grids using multiple simultaneous requestsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Grids, the TeraGrid and beyondComputer, 2003
- Condor-G: a computation management agent for multi-institutional gridsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The Performance Impact of Advance Reservation Meta-schedulingPublished by Springer Nature ,2000
- Globus: a Metacomputing Infrastructure ToolkitThe International Journal of Supercomputer Applications and High Performance Computing, 1997
- The Legion vision of a worldwide virtual computerCommunications of the ACM, 1997