More Web Proxy on the site http://driver.im/

research-article

Post-copy live migration of virtual machines

Authors:

Michael R. Hines,

Umesh Deshpande,

Kartik GopalanAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 43, Issue 3

Pages 14 - 26

https://doi.org/10.1145/1618525.1618528

Published: 31 July 2009 Publication History

Abstract

We present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Post-copy migration defers the transfer of a VM's memory contents until after its processor state has been sent to the target host. This deferral is in contrast to the traditional pre-copy approach, which first copies the memory state over multiple iterations followed by a final transfer of the processor state. The post-copy strategy can provide a "win-win" by reducing total migration time while maintaining the liveness of the VM during migration. We compare post-copy extensively against the traditional pre-copy approach on the Xen Hypervisor. Using a range of VM workloads we show that post-copy improves several metrics including pages transferred, total migration time, and network overhead. We facilitate the use of post-copy with adaptive prepaging techniques to minimize the number of page faults across the network. We propose different prepaging strategies and quantitatively compare their effectiveness in reducing network-bound page faults. Finally, we eliminate the transfer of free memory pages in both pre-copy and post-copy through a dynamic self-ballooning (DSB) mechanism. DSB periodically reclaims free pages from a VM and significantly speeds up migration with negligible performance impact on VM workload.

References

[1]

Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield, A. Xen and the art of virtualization. In Proc. of ACM SOSP 2003 (Oct. 2003).

Digital Library

[2]

Bradford, R., Kotsovinos, E., Feldmann, A., and Schiöberg, H. Live wide-area migration of virtual machines including local persistent state. In Proc. of the International Conference on Virtual Execution Environments (2007), pp. 169--179.

Digital Library

[3]

Clark, C., Fraser, K., Hand, S., Hansen, J., Jul, E., Limpach, C., Pratt, I., and Warfield, A. Live migration of virtual machines. In Network System Design and Implementation (2005).

Digital Library

[4]

Cully, B., Lefebvre, G., and Meyer, D. Remus: High availability via asynchronous virtual machine replication. In NSDI '07: Networked Systems Design and Implementation (2008).

Digital Library

[5]

Denning, P.J. The working set model for program behavior. Communications of the ACM 11, 5 (1968), 323--333.

Digital Library

[6]

Douglis, F. Transparent process migration in the Sprite operating system. Tech. rep., University of California at Berkeley, Berkeley, CA, USA, 1990.

Digital Library

[7]

Hand, S.M. Self-paging in the nemesis operating system. In OSDI'99, New Orleans, Louisiana, USA (1999), pp. 73--86.

Digital Library

[8]

Hansen, J., and Henriksen, A. Nomadic operating systems. In Master's thesis, Dept. of Computer Science, University of Copenhagen, Denmark (2002).

[9]

Hansen, J., and Jul, E. Self-migration of operating systems. In Proc. of ACM SIGOPS Europen Workshop, Leuven, Belgium (2004).

Digital Library

[10]

Hines, M., and Gopalan, K. MemX: Supporting large memory applications in Xen virtual machines. In Second International Workshop on Virtualization Technology in Distributed Computing (VTDC07), Reno, Nevada (2007).

Digital Library

[11]

Hines, M., and Gopalan, K. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proceedings of ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE), Washington, DC (March 2009).

Digital Library

[12]

Ho, R.S., Wang, C.-L., and Lau, F.C. Lightweight process migration and memory prefetching in OpenMosix. In Proc. of IPDPS (2008).

[13]

Kerrighed. http://www.kerrighed.org.

[14]

Kivity, A., Kamay, Y., and Laor, D. KVM: the linux virtual machine monitor. In Proc. of Ottawa Linux Symposium (2007).

[15]

Lagar-Cavilla, H.A., Whitney, J., Scannel, A., Rumble, S., Brudno, M., de Lara, E., and Satyanarayanan, M. Impromptu clusters for near-interactive cloud-based services. Tech. rep., CSRG-578, University of Toronto, June 2008.

[16]

Magenheimer, D. Add self-ballooning to balloon driver. Discussion on Xen Development mailing list and personal communication, April 2008.

[17]

Milojicic, D., Douglis, F., Paindaveine, Y., Wheeler, R., and Zhou, S. Process migration survey. ACM Computing Surveys 32(3) (Sep. 2000), 241--299.

Digital Library

[18]

MOSIX. http://www.mosix.org.

[19]

Nelson, M., Lim, B.-H., and Hutchins, G. Fast transparent migration for virtual machines. In Usenix, Anaheim, CA (2005), pp. 25--25.

Digital Library

[20]

Noack, M. Comparative evaluation of process migration algorithms. Master's thesis, Dresden University of Technology - Operating Systems Group, 2003.

[21]

OpenVZ. Container-based Virtualization for Linux, http://www.openvz.com/.

[22]

Oppenheimer, G., and Weizer, N. Resource management for a medium scale time-sharing operating system. Commun. ACM 11, 5 (1968), 313--322.

Digital Library

[23]

Osman, S., Subhraveti, D., Su, G., and Nieh, J. The design and implementation of Zap: A system for migrating computing environments. In Proc. of OSDI (2002), pp. 361--376.

Digital Library

[24]

Plank, J., Beck, M., Kingsley, G., and Li, K. Libckpt: Transparent checkpointing under UNIX. In Proc. of Usenix Annual Technical Conference, New Orleans, Louisiana (1998).

Digital Library

[25]

Richmond, M., and Hitchens, M. A new process migration algorithm. SIGOPS Oper. Syst. Rev. 31, 1 (1997), 31--42.

Digital Library

[26]

Roush, E.T. Fast dynamic process migration. In Intl. Conference on Distributed Computing Systems (ICDCS) (1996), p. 637.

Digital Library

[27]

Sapuntzakis, C., Chandra, R., and Pfaff, B. Optimizing the migration of virtual computers. In Proc. of OSDI (2002).

Digital Library

[28]

Satyanarayanan, M., and Gilbert, B. Pervasive personal computing in an internet suspend/resume system. IEEE Internet Computing 11, 2 (2007), 16--25.

Digital Library

[29]

Schmidt, B.K. Supporting Ubiquitous Computing with Stateless Consoles and Computation Caches. PhD thesis, Computer Science Dept., Stanford University, 2000.

Digital Library

[30]

Stellner, G. Cocheck: Checkpointing and process migration for MPI. In IPPS '1996 (Washington, DC, USA), pp. 526--531.

Digital Library

[31]

Thain, D., Tannenbaum, T., and Livny, M. Distributed computing in practice: the Condor experience. Concurr. Comput. : Pract. Exper. 17 (2005), 323--356.

Digital Library

[32]

Trivedi, K. An analysis of prepaging. Journal of Computing 22 (1979), 191--210.

[33]

Trivedi, K. On the paging performance of array algorithms. IEEE Transactions on Computers C-26, 10 (Oct. 1977), 938--947.

Digital Library

[34]

Trivedi, K. Prepaging and applications to array algorithms. IEEE Transactions on Computers C-25, 9 (Sept. 1976), 915--921.

Digital Library

[35]

Waldspurger, C. Memory resource management in VMWare ESX server. In Operating System Design and Implementation (OSDI 02), Boston, MA (Dec 2002).

Digital Library

[36]

Whitaker, A., Cox, R., and Shaw, M. Constructing services with interposable virtual hardware. In NSDI 2004 (2004), pp. 13--13.

Digital Library

[37]

Whitaker, A., Shaw, M., and Gribble, S. Scale and performance in the denali isolation kernel. In OSDI 2002, New York, NY, USA (2002), pp. 195--209.

Digital Library

Cited By

Rozehkhani SMahan FPedrycz W(2025)VM consolidation steps in cloud computing: A perspective reviewSimulation Modelling Practice and Theory10.1016/j.simpat.2024.103034138(103034)Online publication date: Jan-2025
https://doi.org/10.1016/j.simpat.2024.103034
(2024)Live Data Replication to A Disaster Recovery Site Using XEN HypervisorComputer Science, Engineering and Technology10.46632/cset/1/1/71:1(54-61)Online publication date: 13-Aug-2024
https://doi.org/10.46632/cset/1/1/7
Ramya Poovizhi JDevi R(2024)Performance Analysis of Different Hypervisors Using Memory and Workloads in OS VirtualizationIntelligent Technologies for Automated Electronic Systems10.2174/9789815179514124010008(74-86)Online publication date: 4-Mar-2024
https://doi.org/10.2174/9789815179514124010008
Show More Cited By

Index Terms

Post-copy live migration of virtual machines
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning
VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

We present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Live migration is an indispensable feature in today's virtualization technologies. Post-copy migration defers the ...
Pre-Copy and post-copy VM live migration for memory intensive applications
Euro-Par'12: Proceedings of the 18th international conference on Parallel processing workshops

Virtualization technology provides a means for server consolidation, reducing the number of physical servers required for running a given workload. Virtual Machine (VM) live migration facilitates the transfer of a running (VM) between physical hosts ...
Live gang migration of virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

This paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 43, Issue 3

July 2009

109 pages

ISSN:0163-5980

DOI:10.1145/1618525

Issue’s Table of Contents

Copyright © 2009 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 July 2009

Published in SIGOPS Volume 43, Issue 3

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

295
Total Citations
View Citations
2,890
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)6

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rozehkhani SMahan FPedrycz W(2025)VM consolidation steps in cloud computing: A perspective reviewSimulation Modelling Practice and Theory10.1016/j.simpat.2024.103034138(103034)Online publication date: Jan-2025
https://doi.org/10.1016/j.simpat.2024.103034
(2024)Live Data Replication to A Disaster Recovery Site Using XEN HypervisorComputer Science, Engineering and Technology10.46632/cset/1/1/71:1(54-61)Online publication date: 13-Aug-2024
https://doi.org/10.46632/cset/1/1/7
Ramya Poovizhi JDevi R(2024)Performance Analysis of Different Hypervisors Using Memory and Workloads in OS VirtualizationIntelligent Technologies for Automated Electronic Systems10.2174/9789815179514124010008(74-86)Online publication date: 4-Mar-2024
https://doi.org/10.2174/9789815179514124010008
Soussi WGür GStiller B(2024)Democratizing Container Live Migration for Enhanced Future Networks - A SurveyACM Computing Surveys10.1145/370443657:4(1-37)Online publication date: 14-Nov-2024
https://dl.acm.org/doi/10.1145/3704436
Zussman TJiang TCidon A(2024)Custom Page Fault Handling With eBPFProceedings of the ACM SIGCOMM 2024 Workshop on eBPF and Kernel Extensions10.1145/3672197.3673432(71-73)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672197.3673432
Mvondo DXing TBarbalace ASchiavoni VEdinger JCao JJin Z(2024)UTwinVM: Reliable hints on the effects of hypervisor updates on VMs in the CloudProceedings of the 25th International Middleware Conference10.1145/3652892.3700752(103-116)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3652892.3700752
Deng JLu JFan HLiu CCheng SFu CZhou WBarcelo PSanchez-Pi NMeliou ASudarshan S(2024)TimeCloth: Fast Point-in-Time Database Recovery in The CloudCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653382(214-226)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3626246.3653382
Afrasiabi SEbrahimzadeh APromwongsa NMouradian CLi WRecse ÁSzabó RGlitho R(2024)Cost-Efficient Cluster Migration of VNFs for Service Function Chain EmbeddingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.328775721:1(979-993)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TNSM.2023.3287757
Rong CWang JWang JZhou YZhang J(2024)Live Migration of Video Analytics Applications in Edge ComputingIEEE Transactions on Mobile Computing10.1109/TMC.2023.324653923:3(2078-2092)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1109/TMC.2023.3246539
Olivier PMehrab AErrabelly SLankes SKaraoui MLyerly RKim SBarbalace ARavindran B(2024)HEXO: Offloading Long-Running Compute- and Memory-Intensive Workloads on Low-Cost, Low-Power Embedded SystemsIEEE Transactions on Cloud Computing10.1109/TCC.2024.348217812:4(1415-1432)Online publication date: Oct-2024
https://doi.org/10.1109/TCC.2024.3482178
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents