Experiences with the KOALA co-allocating scheduler in multiclusters
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 784-791 Vol. 2
- https://doi.org/10.1109/ccgrid.2005.1558642
Abstract
In multicluster systems, and more generally, in grids, jobs may require co-allocation, i.e., the simultaneous allocation of resources such as processors and input files in multiple clusters. While such jobs may have reduced runtimes because they have access to more resources, waiting for processors in multiple clusters and for the input files to become available in the right locations, may introduce inefficiencies. Moreover, as single jobs now have to rely on multiple resource managers, co-allocation introduces reliability problems. In this paper, we present two additions to the original design of our KOALA co-allocating scheduler (different priority levels of jobs and incrementally claiming processors), and we report on our experiences with KOALA in our multicluster testbed while it was unstable.Keywords
This publication has 12 references indexed in Scilit:
- An evaluation of the close-to-files processor and data co-allocation policy in multiclustersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Policy driven heterogeneous resource co-allocation with GangmatchingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Job Superscheduler Architecture and Performance in Computational Grid EnvironmentsPublished by Association for Computing Machinery (ACM) ,2003
- Chimera: a virtual data system for representing, querying, and automating data derivationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Decoupling computation and data scheduling in distributed data-intensive applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A Measurement-Based Simulation Study of Processor Co-allocation in Multicluster SystemsPublished by Springer Nature ,2003
- Mapping Abstract Complex Workflows onto Grid EnvironmentsJournal of Grid Computing, 2003
- Condor-G: a computation management agent for multi-institutional gridsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The Kangaroo approach to data movement on the GridPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Wide-area parallel programming using the remote method invocation modelConcurrency: Practice and Experience, 2000