[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Efficient consolidation-aware VCPU scheduling on multicore virtualization platform

Published: 01 March 2016 Publication History

Abstract

Multicore processors are widely used in today's computer systems. Multicore virtualization technology provides an elastic solution to more efficiently utilize the multicore system. However, the Lock Holder Preemption (LHP) problem in the virtualized multicore systems causes significant CPU cycles wastes, which hurt virtual machine (VM) performance and reduces response latency. The system consolidates more VMs, the LHP problem becomes worse. In this paper, we propose an efficient consolidation-aware vCPU (CVS) scheduling scheme on multicore virtualization platform. Based on vCPU over-commitment rate, the CVS scheduling scheme adaptively selects one algorithm among three vCPU scheduling algorithms: co-scheduling, yield-to-head, and yield-to-tail based on the vCPU over-commitment rate because the actions of vCPU scheduling are split into many single steps such as scheduling vCPUs simultaneously or inserting one vCPU into the run-queue from the head or tail. The CVS scheme can effectively improve VM performance in the low, middle, and high VM consolidation scenarios. Using real-life parallel benchmarks, our experimental results show that the proposed CVS scheme improves the overall system performance while the optimization overhead remains low. We propose an efficient consolidation-aware vCPU (CVS) scheduling scheme.The CVS scheduling scheme adaptively selects three vCPU scheduling algorithms.The CVS scheme can effectively improve virtual machine performance.The CVS scheme works in different consolidation scenarios.

References

[1]
Jia Rao, Xiaobo Zhou, Towards fair and efficient SMP virtual machine scheduling, in: Proc. of PPoPP, 2014.
[2]
K. Chakraborty, P.M. Wells, G.S. Sohi, Supporting over-committed virtual machines through hardware spin detection, IEEE Trans. Parallel Distrib. Syst., 23 (2012).
[3]
W. Jiang, Y. Zhou, et al. CFS Optimizations to KVM threads on multi-core environment, in: Proc. of ICPDS, 2009.
[4]
A.C. Arpaci-Dusseau, Implicit co-scheduling: coordinated scheduling with implicit information in distributed systems, ACM Trans. Comput. Syst., 19 (2001).
[5]
V. Uhlig, J. Levasseur, E. Skoglund, U. Dannowski, Towards scalable multiprocessor virtual machines, in: Virtual Machine Research and Technology Symposium, USENIX, 2004.
[6]
Hitoshi Mitake, Tsung-Han Lin, et al. Using virtual CPU migration to solve the lock holder preemption problem in a multicore processor-based virtualization layer for embedded systems, in: Proc. of ERTCSA, 2012.
[7]
Jian Zhang, Yaozu Dong, Jiangang Duan, ANOLE: A profiling-driven adaptive lock waiter detection scheme for efficient MP-guest scheduling, in: Proc. of Cluster, 2012.
[8]
Lei Zhang, Yu Chen, Yaozu Dong, Chao Liu, Lock-visor: an efficient transitory co-scheduling for MP guest, in: Proc. of ICPP, 2012.
[9]
X. Ding, P.B. Gibbons, M.A. Kozuch, J. Shan, Gleaner: mitigating the blocked-waiter wakeup problem for virtualized multicore applications, in: Proc. of ATC, 2014.
[10]
D.L. Black, Scheduling support for concurrency and parallelism in the Mach operating system, IEEE Comput., 23 (1990) 3543.
[11]
R.W. Wisniewski, L.I. Kontothanassis, M.L. Scott, High performance synchronization algorithms for multiprogrammed multiprocessors, in: Proc. of PPoPP, 1995.
[12]
Y. Yu, Y. Wang, H. Guo, X. He, Hybrid co-scheduling optimizations for concurrent applications in virtualized environments, in: Proc. of NAS, 2011.
[13]
O. Sukwong, H.S. Kim, Is co-scheduling too expensive for SMP VMs? in: Proc. of EuroSys, 2011.
[14]
W. Lee, M. Fran, V. Lee, K. Mackenzie, L. Rudolph, Implications of I/O for gang scheduled workloads, in: Proc. of IPPS, 1997.
[15]
H. Kim, S. Kim, J. Jeong, J. Lee, S. Maeng, Demand-based coordinated scheduling for SMP VMs, in: Proc. of ASPLOS, 2013.
[16]
K.T. Raghavendra, S. Vaddagiri, N. Dadhania, J. Fitzhardinge, Paravirtualization for scalable kernel-based virtual machine (KVM), in: Proc. of CCEM, 2012.
[17]
Yaozu Dong, Xudong Zheng, et al. Improving virtualization performance and scalability with advanced hardware accelerations, in: Proc. of IISWC, 2010.
[18]
Intel Corporation, Intel 64 and IA-32 architecture software developer's manual, December, 2014.
[19]
AMD Corporation, AMD64 architecture programmers manual volume 2: System programming, 2014.
[20]
C. Kolivas, Kernbench, December 2009. http://mirror.sit.wisc.edu/pub/linux/kernel/people/ck/apps/kernbench/.
[21]
J. Ousterhout, Scheduling techniques for concurrent systems, in: Proc. of ICDCS, 1982.
[22]
Y. Wiseman, D. Feitelson, Paired gang scheduling, IEEE Trans. Parallel Distrib. Syst., 14 (2003) 581.
[23]
P. Sobalvarro, S. Pakin, W.E. Weihl, A.A. Chien, Dynamic co-scheduling on workstation clusters, in: Proc. of JSSPP, 1998.
[24]
Chuliang Weng, Qian Liu, Lei Yu, Minglu Li, Dynamic adaptive scheduling for virtual machines, in: Proc. of HPDC, 2011.
[25]
X. Ding, P.B. Gibbons, M.A. Kozuch, A hidden cost of virtualization when scaling multicore applications, in: Proc. of HotCloud, 2013.
[26]
X. Song, J. Shi, H. Chen, B. Zang, Schedule processes, not VCPUs, in: Proc. of APSys, 2013.
[27]
MySQL AB, SysBench manual, 2010.
[28]
H. Jin, M. Frumkin, J. Yan, The OpenMP implementation of NAS parallel Benchmarks and its performance, Tech. Rep. NAS-99-011, NASA Ames Research Center, 2003.

Cited By

View all
  • (2017)APPLES: Efficiently Handling Spin-lock Synchronization on Virtualized PlatformsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.262524928:7(1811-1824)Online publication date: 1-Jul-2017
  • (2017)Multi-Capacity Combinatorial Ordering GA in Application to Cloud resources allocation and efficient virtual machines consolidationFuture Generation Computer Systems10.1016/j.future.2016.10.02569:C(1-10)Online publication date: 1-Apr-2017
  • (2016)Special Issue onFuture Generation Computer Systems10.1016/j.future.2015.11.01756:C(169-170)Online publication date: 1-Mar-2016
  1. Efficient consolidation-aware VCPU scheduling on multicore virtualization platform

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image Future Generation Computer Systems
      Future Generation Computer Systems  Volume 56, Issue C
      March 2016
      787 pages

      Publisher

      Elsevier Science Publishers B. V.

      Netherlands

      Publication History

      Published: 01 March 2016

      Author Tags

      1. Consolidation
      2. Lock holder preemption
      3. Multicore
      4. Virtualization
      5. vCPU scheduling

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 30 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2017)APPLES: Efficiently Handling Spin-lock Synchronization on Virtualized PlatformsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.262524928:7(1811-1824)Online publication date: 1-Jul-2017
      • (2017)Multi-Capacity Combinatorial Ordering GA in Application to Cloud resources allocation and efficient virtual machines consolidationFuture Generation Computer Systems10.1016/j.future.2016.10.02569:C(1-10)Online publication date: 1-Apr-2017
      • (2016)Special Issue onFuture Generation Computer Systems10.1016/j.future.2015.11.01756:C(169-170)Online publication date: 1-Mar-2016

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media