Server consolidation for internet applications in virtualized data centers
Authors: 
Bo Wang, Ying Song, Yuzhong Sun, Jun LiuAuthors Info & Claims
Article No.: 24, Pages 1 - 8
Abstract
Server consolidation based on virtualization technology simplifies system administration and improves energy efficiency by improving resource utilizations and reducing the physical machine (PM) number in contemporary service-oriented data centers. The elasticity of Internet applications changes the consolidation technologies from addressing virtual machines (VMs) to PMs mapping schemes which must know the VMs statuses, i.e. the number of VMs and the profiling data of each VM, into providing the application-to-VM-to-PM mapping. In this paper, we study on the consolidation of multiple Internet applications, minimizing the number of PMs with required performance. We first model the consolidation providing the application-to-VM-to-PM mapping to minimize the number of PMs as an integer linear programming problem, and then present a heuristic algorithm to solve the problem in polynomial time. Extensive experimental results show that our heuristic algorithm consumes less than 4.3% more resources than the optimal amounts with few overheads. Existing consolidation technologies using the input of the VM statuses output by our heuristic algorithm consume 1.06% more PMs.
References
[1]
Ligang He, Deqing Zou, Zhang Zhang, Chao Chen, Hai Jin, and Stephen A. Jarvis. Developing resource consolidation frameworks for moldable virtual machines in clouds. Future Generation Computer Systems, 32(0):69--81, 2014.
[2]
Gergő Lovász, Florian Niedermeier, and Hermann de Meer. Performance tradeoffs of energy-aware virtual machine consolidation. Cluster Computing, 16(3):481--496, 2013.
[3]
Hao Lin, Xin Qi, Shuo Yang, and S. Midkiff. Workload-Driven VM Consolidation in Cloud Data Centers. In Parallel and Distributed Processing Symposium (IPDPS), 2015 IEEE International, pages 207--216, May 2015.
[4]
Fei Xu, Fangming Liu, Linghui Liu, Hai Jin, Bo Li, and Baochun Li. iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud. IEEE Transactions on Computers, 63(12):3012--3025, 2014.
[5]
Akshat Verma, Puneet Ahuja, and Anindya Neogi. pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems. In Middleware 2008, pages 243--264, 2008.
[6]
Benjamin Speitkamp and Martin Bichler. A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers. Services Computing, IEEE Transactions on, 3(4):266--278, 2010.
[7]
Ron C. Chiang and H. Howie Huang. Profiling-Based Workload Consolidation and Migration in Virtualized Data Centers. IEEE Trans. Parallel Distrib. Syst., 26(3):878--890, March 2015.
[8]
Tiago C. Ferreto, Marco A. S. Netto, Rodrigo N. Calheiros, and Csar A. F. De Rose. Server Consolidation with Migration Control for Virtualized Data Centers. Future Generation Computer Systems, 27(8):1027--1034, 2011.
[9]
Shekhar Srikantaiah, Aman Kansal, and Feng Zhao. Energy Aware Consolidation for Cloud Computing. In Proceedings of the 2008 Conference on Power Aware Computing and Systems (HotPower'08), 2008.
[10]
Xiaocheng Liu, Chen Wang, Bing Bing Zhou, Junliang Chen, Ting Yang, and A. Y. Zomaya. Priority-Based Consolidation of Parallel Workloads in the Cloud. Parallel and Distributed Systems, IEEE Transactions on, 24(9):1874--1883, Sept 2013.
[11]
Jing Jiang, Jie Lu, Guangquan Zhang, and Guodong Long. Optimal Cloud Resource Auto-Scaling for Web Applications. In Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on, pages 58--65, May 2013.
[12]
Junliang Chen, Chen Wang, Bing Bing Zhou, Lei Sun, Young Choon Lee, and Albert Y. Zomaya. Tradeoffs Between Profit and Customer Satisfaction for Service Provisioning in the Cloud. In HPDC '11, pages 229--238, New York, NY, USA, 2011. ACM.
[13]
Emiliano Casalicchio and Luca Silvestri. Mechanisms for SLA provisioning in cloud-based service providers. Computer Networks, 57(3):795--810, 2013.
[14]
Zhipiao Liu, Shangguang Wang, Qibo Sun, Hua Zou, and Fangchun Yang. Cost-Aware Cloud Service Request Scheduling for SaaS Providers. The Computer Journal, 57(2):291--301, 2014.
[15]
Linlin Wu, Saurabh Kumar Garg, and Rajkumar Buyya. SLA-based admission control for a Software-as-a-Service provider in Cloud computing environments. Journal of Computer and System Sciences, 78(5):1280--1299, 2012.
[16]
Nedeljko Vasić, Dejan Novaković, Svetozar Miučin, Dejan Kostić, and Ricardo Bianchini. DejaVu: Accelerating Resource Allocation in Virtualized Environments. In Proceedings of the Seventeenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS XVII), pages 423--436, New York, NY, USA, 2012. ACM.
[17]
Amiya K. Maji, Subrata Mitra, Bowen Zhou, Saurabh Bagchi, and Akshat Verma. Mitigating Interference in Cloud Services by Middleware Reconfiguration. In Middleware '14, pages 277--288, New York, NY, USA, 2014. ACM.
[18]
Pradeep Padala, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant. Automated Control of Multiple Virtualized Resources. In Proceedings of the 4th ACM European Conference on Computer Systems (EuroSys '09), pages 13--26, New York, NY, USA, 2009. ACM.
[19]
Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, and John Wilkes. CloudScale: Elastic Resource Scaling for Multi-tenant Cloud Systems. In Proceedings of the 2Nd ACM Symposium on Cloud Computing (SOCC '11), pages 5:1--5:14, New York, NY, USA, 2011. ACM.
[20]
L. Yazdanov and C. Fetzer. VScaler: Autonomic Virtual Machine Scaling. In Cloud Computing (CLOUD), 2013 IEEE Sixth International Conference on, pages 212--219, June 2013.
[21]
Wesam Dawoud, Ibrahim Takouna, and Christoph Meinel. Elastic Virtual Machine for Fine-Grained Cloud Resource Provisioning. In P. Venkata Krishna, M. Rajasekhara Babu, and Ezendu Ariwa, editors, Global Trends in Computing and Communication Systems, volume 269, pages 11--25. Springer Berlin Heidelberg, 2012.
[22]
P. Lama and Xiaobo Zhou. PERFUME: Power and performance guarantee with fuzzy MIMO control in virtualized servers. In Quality of Service (IWQoS), 2011 IEEE 19th International Workshop on, pages 1--9, June 2011.
[23]
Pengcheng Xiong, Zhikui Wang, S. Malkowski, Qingyang Wang, D. Jayasinghe, and C. Pu. Economical and Robust Provisioning of N-Tier Cloud Workloads: A Multi-level Control Approach. In Distributed Computing Systems (ICDCS), 2011 31st International Conference on, pages 571--580, June 2011.
[24]
Rui Han, Moustafa M. Ghanem, Li Guo, Yike Guo, and Michelle Osmond. Enabling cost-aware and adaptive elasticity of multi-tier cloud applications. Future Generation Computer Systems, 32(0):82--98, 2014.
[25]
Upendra Sharma, Prashant Shenoy, Sambit Sahu, and Anees Shaikh. A Cost-Aware Elasticity Provisioning System for the Cloud. In Proceedings of the 2011 31st International Conference on Distributed Computing Systems (ICDCS '11), pages 559--570, Washington, DC, USA, 2011.
[26]
Mina Sedaghat, Francisco Hernandez-Rodriguez, and Erik Elmroth. A Virtual Machine Re-packing Approach to the Horizontal vs. Vertical Elasticity Trade-off for Cloud Autoscaling. In Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference (CAC '13), pages 6:1--6:10, New York, NY, USA, 2013. ACM.
[27]
S. Dutta, S. Gera, Akshat Verma, and B. Viswanathan. Smartscale: Automatic application scaling in enterprise clouds. In Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on, pages 221--228, June 2012.
[28]
Miguel Caballer, A García, Germán Moltó, and Carlos de Alfonso. Towards SLA-driven management of cloud infrastructures to elastically execute scientific applications. In 6th Iberian Grid Infrastructure Conference (IberGrid), pages 207--218, 2012.
[29]
Chien-Yu Liu, Meng-Ru Shie, Yi-Fang Lee, Yu-Chun Lin, and Kuan-Chou Lai. Vertical/Horizontal Resource Scaling Mechanism for Federated Clouds. In Information Science and Applications (ICISA), 2014 International Conference on, pages 1--4, May 2014.
[30]
Gueyoung Jung, KaustubhR. Joshi, MattiA. Hiltunen, RichardD. Schlichting, and Calton Pu. A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications. In JeanM. Bacon and BrianF. Cooper, editors, Middleware 2009, volume 5896, pages 163--183, 2009.
[31]
Wenting Wang, Haopeng Chen, and Xi Chen. An Availability-Aware Virtual Machine Placement Approach for Dynamic Scaling of Cloud Applications. In Ubiquitous Intelligence Computing and 9th International Conference on Autonomic Trusted Computing (UIC/ATC), 2012 9th International Conference on, pages 509--516, Sept 2012.
[32]
Pengcheng Xiong, Yun Chi, Shenghuo Zhu, Hyun Jin Moon, C. Pu, and H. Hacgumus. SmartSLA: Cost-Sensitive Management of Virtualized Resources for CPU-Bound Database Services. Parallel and Distributed Systems, IEEE Transactions on, 26(5):1441--1451, May 2015.
[33]
U Hoelzle and L Barroso. The datacenter as a computer. Morgan and Claypool, 2009.
[34]
L. A. Barroso and U. Holzle. The Case for Energy-Proportional Computing. Computer, 40(12):33--37, Dec 2007.
[35]
A. Strunk and W. Dargie. Does Live Migration of Virtual Machines Cost Energy? In Advanced Information Networking and Applications (AINA), 2013 IEEE 27th International Conference on, pages 514--521, March 2013.
[36]
Haikun Liu, Cheng-Zhong Xu, Hai Jin, Jiayu Gong, and Xiaofei Liao. Performance and Energy Modeling for Live Migration of Virtual Machines. In HPDC '11, pages 171--182, New York, NY, USA, 2011. ACM.
[37]
Fei Xu, Fangming Liu, Hai Jin, and A. V. Vasilakos. Managing Performance Overhead of Virtual Machines in Cloud Computing: A Survey, State of the Art, and Future Directions. Proceedings of the IEEE, 102(1):11--31, Jan 2014.
[38]
Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2/, 2015.
[39]
Krasimira Genova and Vassil Guliashki. Linear Integer Programming Methods and Approaches--a Survey. Journal of Cybernetics and Information Technologies, 11(1), 2011.
[40]
H. W. Cain, R. Rajwar, M. Marden, and M. H. Lipasti. An Architectural Evaluation of Java TPC-W. In HPCA 2001, pages 229--240, 2001.
[41]
Brian F. Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. Benchmarking Cloud Serving Systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10, pages 143--154, New York, NY, USA, 2010. ACM.
[42]
ab - Apache HTTP server benchmarking tool. http://httpd.apache.org/docs/2.2/programs/ab.html, 2015.
[43]
Xing Pu, Ling Liu, Yiduo Mei, S. Sivathanu, Younggyun Koh, C. Pu, and Yuanda Cao. Who Is Your Neighbor: Net I/O Performance Interference in Virtualized Clouds. Services Computing, IEEE Transactions on, 6(3):314--329, July 2013.
[44]
SysBench: a System Performance Benchmark. https://github.com/akopytov/sysbench, 2015.
[45]
M. Arlitt and T. Jin. A workload characterization study of the 1998 World Cup Web site. Network, IEEE, 14(3):30--37, May 2000.
[46]
Yasuhiro Ajiro and Atsuhiro Tanaka. Improving packing algorithms for server consolidation. In Int. CMG Conference, pages 399--406, 2007.
[47]
OpenStack. http://www.openstack.org/, 2015.
[48]
Sheldon M. Ross. Introduction to Probability and Statistics for Engineers and Scientists, chapter 6--8, pages 207--356. Academic Press, Boston, 5 edition, 2014.
Recommendations
Server consolidation with migration control for virtualized data centers
Virtualization has become a key technology for simplifying service management and reducing energy costs in data centers. One of the challenges faced by data centers is to decide when, how, and which virtual machines (VMs) have to be consolidated into a ...
A survey on virtual machine migration and server consolidation frameworks for cloud data centers
Modern Cloud Data Centers exploit virtualization for efficient resource management to reduce cloud computational cost and energy budget. Virtualization empowered by virtual machine (VM) migration meets the ever increasing demands of dynamic workload by ...
Two Optimization Mechanisms to Improve the Isolation Property of Server Consolidation in Virtualized Multi-core Server
HPCC '10: Proceedings of the 2010 IEEE 12th International Conference on High Performance Computing and CommunicationsVirtualization brings many benefits such as improving system utilization and reducing cost through server consolidation. However, it also introduces isolation problem when running multiple virtual machine workloads in one physical platform. Additionally,...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
April 2016
210 pages
ISBN:9781510823181
- General Chairs:
- Josef Weinbub,
- Marc Baboulin,
- Program Chairs:
- William Thacker,
- Lukas Polok
Publisher
Society for Computer Simulation International
San Diego, CA, United States
Publication History
Published: 03 April 2016
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 42Total Downloads
- Downloads (Last 12 months)22
- Downloads (Last 6 weeks)4
Reflects downloads up to 27 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in