High performance virtual machine migration with RDMA over modern interconnects
- 1 January 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15525244,p. 11-20
- https://doi.org/10.1109/clustr.2007.4629212
Abstract
One of the most useful features provided by virtual machine (VM) technologies is the ability to migrate running OS instances across distinct physical nodes. As a basis for many administration tools in modern clusters and data-centers, VM migration is desired to be extremely efficient to reduce both migration time and performance impact on hosted applications. Currently, most VM environments use the Socket interface and the TCP/IP protocol to transfer VM migration traffic. In this paper, we propose a high performance VM migration design by using RDMA (Remote Direct Memory Access). RDMA is a feature provided by many modern high speed interconnects that are currently being widely deployed in data-centers and clusters. By taking advantage of the low software overhead and the one-sided nature of RDMA, our design significantly improves the efficiency of VM migration. We also contribute a set of micro-benchmarks and application-level benchmark evaluations aimed at evaluating important metrics of VM migration. The evaluations using our prototype implementation over Xen and InfiniBand show that RDMA can drastically reduce the migration overhead: up to 80% on total migration time and up to 77% on application observed downtime.Keywords
This publication has 11 references indexed in Scilit:
- Proactive fault tolerance for HPC with Xen virtualizationPublished by Association for Computing Machinery (ACM) ,2007
- NomadPublished by Association for Computing Machinery (ACM) ,2007
- Seamless live migration of virtual machines over the MAN/WANFuture Generation Computer Systems, 2006
- A case for high performance computing with virtual machinesPublished by Association for Computing Machinery (ACM) ,2006
- High performance support of parallel virtual file system (PVFS2) over QuadricsPublished by Association for Computing Machinery (ACM) ,2005
- Diagnosing performance overheads in the xen virtual machine environmentPublished by Association for Computing Machinery (ACM) ,2005
- A case for grid computing on virtual machinesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- TCP performance re-visitedPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- High performance RDMA-based MPI implementation over InfiniBandPublished by Association for Computing Machinery (ACM) ,2003
- DiscoACM Transactions on Computer Systems, 1997