DBMS-Assisted Live Migration of Virtual Machines
Pages 380 - 393
Abstract
Live migration of virtual machines (VMs) is a technique that moves active VMs between different physical hosts without losing any running states. Although it is desirable for administrators that the live migration is completed as quickly as possible, the pre-copy-based live migration, widely used in modern hypervisors, does not satisfy this demand on the current trend that VMs on which running applications are performance-critical such as database management systems (DBMSes) have quite large memory. <italic>DMigrate</italic>, presented in this paper, shortens the time for live-migrating VMs with even large memory DBMSes. To quickly produce the running state of the migrating VMs on the destination, DMigrate performs regular memory transfers while simultaneously constructing the DBMS's buffer-pool by fetching the data items from the shared storage. We prototyped DMigrate on MySQL 5.7.30, QEMU 5.1.0, and Linux 4.18.20. The experimental results show that the migration time of the prototype is up to 1.71<inline-formula><tex-math notation="LaTeX">$\boldsymbol{\times}$</tex-math><alternatives><mml:math><mml:mo mathvariant="bold">×</mml:mo></mml:math><inline-graphic xlink:href="yamada-ieq1-3329943.gif"/></alternatives></inline-formula> and 1.71<inline-formula><tex-math notation="LaTeX">$\boldsymbol{\times}$</tex-math><alternatives><mml:math><mml:mo mathvariant="bold">×</mml:mo></mml:math><inline-graphic xlink:href="yamada-ieq2-3329943.gif"/></alternatives></inline-formula> shorter under workloads, including sysbench and TPC-C, than the default pre-copy and post-copy schemes, respectively.
References
[1]
F. Hermenier, X. Lorca, J.-M. Menaud, G. Muller, and J. Lawall, “Entropy: A consolidation manager for clusters,” in Proc. 5th ACM Int. Conf. Virtual Execution Environ. (VEE), 2009, pp. 41–50.
[2]
H. Wang, C. Isci, L. Subramanian, J. Choi, D. Qian, and O. Mutlu, “A-DRM: Architecture-aware distributed resource management of virtualized clusters,” in Proc. 11th ACM Int. Conf. Virtual Execution Environ. (VEE), 2015, pp. 93–106.
[3]
S. Govindan, D. Wang, A. Sivasubramaniam, and B. Urgaonkar, “Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters,” in Proc. 17th ACM Int. Conf. Archit. Support Program. Lang. Operating Syst. (ASPLOS), 2012, pp. 75–86.
[4]
M. Wang, X. Meng, and L. Zhang, “Consolidating virtual machines with dynamic bandwidth demand in data centers,” in Proc. 30th IEEE Int. Conf. Comput. Commun. (INFOCOM), 2011, pp. 71–75.
[5]
X. Zhang et al., “Fast and scalable VMM live upgrade in large cloud infrastructure,” in Proc. 24th Int. Conf. Archit. Support Program. Lang. Operating Syst., New York, NY, USA: ACM, Apr. 2019, pp. 93–105.
[6]
S. Doddamani, T. H. K. Cheng, P. Sinha, H. H. Bagdi, H. Lu, and K. Gopalan, “Fast and live hypervisor replacement,” in Proc. 15th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ., 2019, pp. 45–58.
[7]
A. Ruprecht et al., “VM live migration at scale,” in Proc. 14th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ. (VEE), 2018, pp. 45–56.
[8]
C. Clark et al., “Live migration of virtual machines,” in Proc. 2nd USENIX Symp. Networked Syst. Des. Implementation (NSDI), 2005, pp. 273–286.
[9]
P. Barham et al., “Xen and art of virtualization,” in Proc. 19th ACM Symp. Operating. Syst. Princ. (SOSP), Oct. 2003, pp. 164–177.
[10]
A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori, “kvm: The Linux virtual machine monitor,” in Proc. Linux Symp., 2007, pp. 225–230.
[11]
“Windows server Hyper-V.” Microsoft. Accessed: Oct. 1, 2022. [Online]. Available: https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx
[12]
“Amazon Relational Database Service (Amazon RDS).” Amazon Web Services. Accessed: Oct. 1, 2022. [Online]. Available: https://aws.amazon.com/rds/
[13]
M. R. Hines, U. Deshpande, and K. Gopalan, “Post-copy live migration of virtual machines,” J. ACM SIGOPS Operating Syst. Rev., vol. 43, no. 3, pp. 14–26, Jul. 2009.
[14]
Y. Abe, R. Geambasu, K. Joshi, and M. Satyanarayanan, “Urgent virtual machine eviction with enlightened post-copy,” in Proc. 12th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ., 2016, pp. 51–64.
[15]
D. Fernando, J. Terner, K. Gopalan, and P. Yang, “Live migration ate my VM: Recovering a virtual machine after failure of post-copy live migration,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), Jun. 2019, pp. 343–351.
[16]
K.-Y. Hou, K. Shin, and J.-L. Sung, “Application-assisted live migration of virtual machines with Java applications,” in Proc. 10th ACM SIGOPS Eur. Conf. Comput. Syst. (EuroSys), 2015, pp. 15:1–15:15.
[17]
X. Song, J. Shi, R. Liu, J. Yang, and H. Chen, “Parallelizing live migration of virtual machines,” in Proc. 9th ACM Int. Conf. Virtual Execution Environ. (VEE), 2013, pp. 85–96.
[18]
A. Koto, H. Yamada, K. Ohmura, and K. Kono, “Towards unobtrusive VM live migration for cloud computing platforms,” in Proc. 3rd ACM Asia-Pacific Conf. Syst. (APSys), 2012, pp. 7:1–7:6.
[19]
C. Jo, E. Gustafsson, J. Son, and B. Egger, “Efficient live migration of virtual machines using shared storage,” in Proc. 9th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ. (VEE), 2013, pp. 41–50.
[20]
C. Li et al., “BAC: Bandwidth-aware compression for efficient live migration of virtual machines,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), 2017, pp. 1–9.
[21]
P. Sväard, B. Hudzia, J. Tordsson, and E. Elmroth, “Evaluation of delta compression techniques for efficient live migration of large virtual machines,” in Proc. 7th ACM Int. Conf. Virtual Execution Environ. (VEE), 2011, pp. 111–120.
[22]
L. Cui et al., “VMScatter: Migrate virtual machines to many hosts,” in Proc. 9th ACM Int. Conf. Virtual Execution Environ. (VEE), 2013, pp. 63–72.
[23]
A. Rai, R. Ramjee, A. Anand, V. N. Padmanabhan, and G. Varghese, “MiG: Efficient migration of desktop VMs using semantic compression,” in Proc. USENIX Conf. Annu. Tech. Conf. (USENIX ATC), 2013, pp. 25–36.
[24]
J.-H. Chiang, H.-L. Li, and T. Chiueh, “Introspection-based memory de-duplication and migration,” in Proc. 9th ACM Int. Conf. Virtual Execution Environ. (VEE), 2013, pp. 51–62.
[25]
T. Wood, K. K. Ramakrishnan, P. Shenoy, and J. van der Merwe, “CloudNet: Dynamic pooling of cloud resources by live WAN migration of virtual machines,” in Proc. 7th ACM Int. Conf. Virtual Execution Environ. (VEE), 2011, pp. 121–132.
[26]
W. Huang, Q. Gao, J. Liu, and D. K. Panda, “High performance virtual machine migration with RDMA over modern interconnects,” in Proc. IEEE Int. Conf. Cluster Comput. (Cluster), 2007, pp. 11–20.
[27]
D. Fernando, P. Yang, and H. Lu, “SDN-based order-aware live migration of virtual machines,” in Proc. IEEE Conf. Comput. Commun. (INFOCOM), 2020, pp. 1818–1827.
[28]
S. Ghorbani et al., “Transparent, live migration of a software-defined network,” in Proc. ACM Symp. Cloud Comput. (SoCC), 2014, pp. 3:1–3:14.
[29]
A. J. Mashtizadeh, M. Cai, G. Tarasuk-Levin, R. Koller, T. Garfinkel, and S. Setty, “XvMotion: Unified virtual machine migration over long distance,” in Proc. USENIX Conf. Annu. Tech. Conf. (USENIX ATC), 2014, pp. 97–108.
[30]
R. H. O. Online, “Linux KVM.” Accessed: Oct. 21, 2021. [Online]. Available: https://linux-kvm.org/page/Main_Page
[31]
P. Lu, A. Barbalace, and B. Ravindran, “HSG-LM: Hybrid-copy speculative guest OS live migration without hypervisor,” in Proc. 6th Int. Syst. Storage Conf. (SYSTOR), 2013, pp. 2:1–2:11.
[32]
J. Zheng, T. S. E. Ng, and K. Sripanidkulchai, “Workload-aware live storage migration for clouds,” in Proc. 7th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ. (VEE), 2011, pp. 133–144.
[33]
T. Wood et al., “Memory buddies: Exploiting page sharing for smart colocation in virtualized data centers,” in Proc. ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ. (VEE), 2009, pp. 31–40.
[34]
P. M. Chen and B. D. Noble, “When virtual is better than real,” in Proc. 8th Workshop Hot Topics Operating Syst. (HotOS), Jun. 2001, pp. 133–138.
[35]
J. J. Herne, “Qemu features/autoconvergelivemigration,” 2016. Accessed: Oct. 1, 2022. [Online]. Available: https://wiki.qemu.org/Features/AutoconvergeLiveMigration
[36]
H. Li, G. Xiao, Y. Zhang, P. Gao, Q. Lu, and J. Yao, “Adaptive live migration of virtual machines under limited network bandwidth,” in Proc. 17th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ., 2021, pp. 98–110.
[37]
J. Kang et al., “Remus: Efficient live migration for distributed databases with snapshot isolation,” in Proc. Int. Conf. Manage. Data, 2022, pp. 2232–2245.
[38]
T. Mishima and Y. Fujiwara, “Madeus: Database live migration middleware under heavy workloads for cloud environment,” in Proc. ACM SIGMOD Int. Conf. Manage. Data (SIGMOD), 2015, pp. 315–329.
[39]
Y.-S. Lin, S.-K. Pi, M.-K. Liao, C. Tsai, A. Elmore, and S.-H. Wu, “MgCrab: Transaction crabbing for live migration in deterministic database systems,” Proc. VLDB Endowment, vol. 12, no. 5, pp. 597–610, Jan. 2019.
[40]
A. J. Elmore, S. Das, D. Agrawal, and A. E. Abbadi, “Zephyr: Live migration in shared nothing databases for elastic cloud platforms,” in Proc. ACM Int. Conf. Manage. Data (SIGMOD), 2011, pp. 301–312.
[41]
S. Das, S. Nishimura, D. Agrawal, and A. El Abbadi, “Albatross: Lightweight elasticity in shared storage databases for the cloud using live data migration,” Proc. VLDB Endowment, vol. 4, no. 8, pp. 494–505, 2011.
[42]
“User guide for Linux instances.” Amazon Web Services, 2022. Accessed: Oct. 1, 2022. [Online]. Available: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/
[43]
“PostgreSQL: The world's most advanced open source relational database.” The PostgreSQL Global Development Group. Accessed: Oct. 1, 2022. [Online]. Available: https://www.postgresql.org/
[44]
“iPerf: The TCP/UDP bandwidth measurement tool,” distributed by CiNii. Accessed: Oct. 1, 2022. [Online.] Available: http://dast.nlanr.net/Projects/Iperf/
[45]
M. Zaharia et al., “Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing,” in Proc. 9th USENIX Symp. Networked Syst. Des. Implementation (NSDI), 2012, pp. 15–28.
Index Terms
- DBMS-Assisted Live Migration of Virtual Machines
Index terms have been assigned to the content through auto-classification.
Recommendations
Live gang migration of virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computingThis paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". ...
Traffic-sensitive live migration of virtual machines
CCGRID '15: Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid ComputingIn this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source ...
Inter-rack live migration of multiple virtual machines
VTDC '12: Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing DateWithin datacenters, often multiple virtual machines (VMs) need to be live migrated simultaneously for various reasons such as maintenance, power savings, and load balancing. Such mass simultaneous live migration of multiple VMs can trigger large data ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2023 The Authors. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/.
Publisher
IEEE Computer Society
United States
Publication History
Published: 07 November 2023
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025