Virtual Clusters on the Fly - Fast, Scalable, and Flexible Installation
- 1 May 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 549-556
- https://doi.org/10.1109/ccgrid.2007.121
Abstract
One of the advantages in virtualized computing clusters compared to traditional shared HPC environments is their ability to accommodate user-specific system customization. However, past attempts to providing virtual clusters are not scalable with increasing number of VMs, nor do they allow fine-grained customization of VMs, assuming that preconfigured VM images are always available on the grid. We propose a new virtual cluster installation technique that achieves efficiency and scalability, and yet simultaneously fine-grained customizability. It allows the user to create VMs on the fly for fine-grained customization of VMs, and pipelined data transfer for scalable installation with increasing number of VMs. To achieve efficiency in the presence of such full customization, it automatically caches frequently-constructed virtual disk images to save software installation time in common cases. Our experimental studies using a prototype implementation show that installation of a 190-node virtual cluster can be done in 40 seconds. From this result along with a scalability study, we estimate that installation of a 1000-node virtual cluster could be done in less than two minutes.Keywords
This publication has 10 references indexed in Scilit:
- Overhead Matters: A Model for Virtual Resource ManagementPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Virtual Clusters for Grid CommunitiesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- From virtualized resources to virtual computing grids: the In-VIGO systemFuture Generation Computer Systems, 2005
- VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid ComputingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Dynamic virtual clusters in a grid site managerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Condor-a hunter of idle workstationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Xen and the art of virtualizationPublished by Association for Computing Machinery (ACM) ,2003
- NPACI: rocks: tools and techniques for easily deploying manageable Linux clustersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- The network weather service: a distributed resource performance forecasting service for metacomputingFuture Generation Computer Systems, 1999
- A high-performance, portable implementation of the MPI message passing interface standardParallel Computing, 1996