More Web Proxy on the site http://driver.im/

article

Improving performance by network-aware virtual machine clustering and consolidation

Authors:

Mianxiong Dong,

Sanglu LuAuthors Info & Claims

The Journal of Supercomputing, Volume 74, Issue 11

Pages 5846 - 5864

https://doi.org/10.1007/s11227-017-2104-9

Published: 01 November 2018 Publication History

Abstract

Modern data center consists of thousands of servers, racks and switches. Complicated structure means it requires well-designed algorithms to utilize resources of data centers efficiently. Current virtual machine scheduling algorithms mainly focus on the initial allocation of virtual machines based on the CPU, memory and network bandwidth requirements. However, when tasks finished or lease expired, related virtual machines would be deleted from the system which would generate resource fragments. Such fragments lead to unbalanced resource utilization and decline of communication performance. This paper investigates the network influence on typical applications in data centers and proposed a self-adaptive network-aware virtual machine clustering and consolidation algorithm to maintain an optimal system-wide status. Our consolidation algorithm periodically checks whether consolidation is necessary and then clusters and consolidates virtual machines to lower communication cost with an online heuristic. We used two benchmarks in a real environment to examine network influence on different tasks. To evaluate the advantages of the proposed algorithm, we also built a cloud computing testbed. Real workload trace-driven simulations and testbed-based experiments showed that, our algorithm greatly shortened the average finish time of map-reduce tasks and reduced time delay of web applications. Simulation results showed that our algorithm considerably reduced the amount of high-delay jobs, lowered the average traffic passed through aggregate switches and improved the communication ability among virtual machines.

References

[1]

Alicherry M, Lakshman TV (2012) Network aware resource allocation in distributed clouds. In: Proceedings of International Conference on Computer Communications, IEEE

[2]

Beloglazov A, Buyya R (2015) OpenStack Neat: a framework for dynamic and energy-efficient consolidation of virtual machines in OpenStack clouds. Concurr Comput Pract Exp 27(5):1310---1333

Digital Library

[3]

Biran O et al. (2012) A stable network-aware vm placement for cloud systems. In: Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, IEEE Computer Society

Digital Library

[4]

Breitgand D, Kutiel G, Raz D (2010) Cost-aware live migration of services in the cloud. In: Proceedings of the 3rd Annual Haifa Experimental Systems Conference, ACM

Digital Library

[5]

Dutta S, Verma A (2011) Service deactivation aware placement and defragmentation in enterprise clouds. In: Proceedings of the 7th International Conference on Network and Services Management, International Federation for Information Processing

Digital Library

[6]

Ferdaus MH, Murshed M, Calheiros RN, et al. (2015) Network-aware virtual machine placement and migration in cloud data centers. In: Emerging research in cloud distributed computing systems, Chap 2, pp 42---91.

[7]

Iqbal W, Dailey MN, Carrera D (2010) Sla-driven dynamic resource management for multi-tier web applications in a cloud. In: 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid), IEEE

Digital Library

[8]

Jiang JW et al (2012) Joint VM placement and routing for data center traffic engineering. In: Proceedings of International Conference on Computer Communications, IEEE

[9]

Kliazovich D, Bouvry P, Khan SU (2013) DENS: data center energy-efficient network-aware scheduling. J Cluster Comput 16(1):65---75

Digital Library

[10]

Meng X, Pappas V, Zhang L (2010) Improving the scalability of data center networks with traffic-aware virtual machine placement. In: Proceedings of International Conference on Computer Communications, IEEE

Digital Library

[11]

Murty KG, Kabadi SN (1987) Some NP-complete problems in quadratic and nonlinear programming. Math Program 39(2):117---129

[12]

Nguyen Van H, Dang Tran F, Menaud JM (2009) Autonomic virtual resource management for service hosting platforms. In: Proceedings of the ICSE Workshop on Software Engineering Challenges of Cloud Computing, IEEE

Digital Library

[13]

Shrivastava V et al. (2011) Application-aware virtual machine migration in data centers. In: Proceedings of International Conference on Computer Communications, IEEE

[14]

Stage A, Setzer T (2009) Network-aware migration control and scheduling of differentiated virtual machine workloads. In: Proceedings of the ICSE Workshop on Software Engineering Challenges of Cloud Computing. IEEE Computer Society

Digital Library

[15]

Steiner M et al (2012) Network-aware service placement in a distributed cloud environment. J ACM SIGCOMM Comput Commun Rev 42(4):73---74

Digital Library

[16]

Stoer M, Wagner F (1997) A simple min-cut algorithm. J ACM (JACM) 44(4):585---591

Digital Library

[17]

Wang M, Meng X, Zhang L (2011) Consolidating virtual machines with dynamic bandwidth demand in data centers. In: Proceedings of International Conference on Computer Communications, IEEE

[18]

Wilson C et al (2011) Better never than late: meeting deadlines in data center networks. J ACM SIGCOMM Comput Commun Rev 41(4):50---61

Digital Library

[19]

Xia M, Shirazipour M, Zhang Y, Green H, Takacs A (2015) Network function placement for NFV chaining in packet/optical data centers. J Lightwave Technol 33(8):1565---1570

[20]

Xu J, Fortes JAB (2010) Multi-objective virtual machine placement in virtualized data center environments. In: IEEE/ACM Int'l Conference on Green Computing and Communications, & Int'l Conference on Cyber, Physical and Social Computing, IEEE

Digital Library

[21]

Zhu J et al (2012) Towards bandwidth guarantee in multi-tenancy cloud computing networks. In: Proceedings of 20th IEEE International Conference on Network Protocols, IEEE

Digital Library

Cited By

Perumal KMohan SFrnda JDivakarachari P(2022)Dynamic resource provisioning and secured file sharing using virtualization in cloud azureJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-022-00326-111:1Online publication date: 19-Sep-2022
https://dl.acm.org/doi/10.1186/s13677-022-00326-1
Karmakar KDas RKhatua S(2020)Bandwidth allocation for communicating virtual machines in cloud data centersThe Journal of Supercomputing10.1007/s11227-019-03128-676:9(7268-7289)Online publication date: 1-Sep-2020
https://dl.acm.org/doi/10.1007/s11227-019-03128-6
Hejja KHesselbach X(2019)Evaluating impacts of traffic migration and virtual network functions consolidation on power aware resource allocation algorithmsFuture Generation Computer Systems10.1016/j.future.2019.06.015101:C(83-98)Online publication date: 1-Dec-2019
https://dl.acm.org/doi/10.1016/j.future.2019.06.015
Show More Cited By

Improving performance by network-aware virtual machine clustering and consolidation
1. General and reference
  1. Cross-computing tools and techniques

Recommendations

Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration

Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...
Structure-aware online virtual machine consolidation for datacenter energy improvement in cloud computing

The necessity and significance of improving the energy efficiency of cloud implementations have increased due to the rapid growth and proliferation of cloud computing services around the world. Virtual machines (VMs) comprise the backend of most, if not ...
Resource availability based performance benchmarking of virtual machine migrations
ICPE '13: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering

Virtual machine migration enables load balancing, hot spot mitigation and server consolidation in virtualized environments. Live VM migration can be of two types - adaptive, in which the rate of page transfer adapts to virtual machine behaviour (mainly ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image The Journal of Supercomputing

The Journal of Supercomputing Volume 74, Issue 11

November 2018

776 pages

ISSN:0920-8542

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer Science+Business Media, LLC, part of Springer Nature.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 November 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Perumal KMohan SFrnda JDivakarachari P(2022)Dynamic resource provisioning and secured file sharing using virtualization in cloud azureJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-022-00326-111:1Online publication date: 19-Sep-2022
https://dl.acm.org/doi/10.1186/s13677-022-00326-1
Karmakar KDas RKhatua S(2020)Bandwidth allocation for communicating virtual machines in cloud data centersThe Journal of Supercomputing10.1007/s11227-019-03128-676:9(7268-7289)Online publication date: 1-Sep-2020
https://dl.acm.org/doi/10.1007/s11227-019-03128-6
Hejja KHesselbach X(2019)Evaluating impacts of traffic migration and virtual network functions consolidation on power aware resource allocation algorithmsFuture Generation Computer Systems10.1016/j.future.2019.06.015101:C(83-98)Online publication date: 1-Dec-2019
https://dl.acm.org/doi/10.1016/j.future.2019.06.015
Bermejo BJuiz CGuerrero C(2019)Virtualization and consolidationThe Journal of Supercomputing10.1007/s11227-018-2613-175:2(808-836)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s11227-018-2613-1

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents