More Web Proxy on the site http://driver.im/

Article

Adaptive control of virtualized resources in utility computing environments

Authors:

Pradeep Padala,

Sharad Singhal,

Kenneth SalemAuthors Info & Claims

EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007

Pages 289 - 302

https://doi.org/10.1145/1272996.1273026

Published: 21 March 2007 Publication History

Abstract

Data centers are often under-utilized due to over-provisioning as well as time-varying resource demands of typical enterprise applications. One approach to increase resource utilization is to consolidate applications in a shared infrastructure using virtualization. Meeting application-level quality of service (QoS) goals becomes a challenge in a consolidated environment as application resource needs differ. Furthermore, for multi-tier applications, the amount of resources needed to achieve their QoS goals might be different at each tier and may also depend on availability of resources in other tiers. In this paper, we develop an adaptive resource control system that dynamically adjusts the resource shares to individual tiers in order to meet application-level QoS goals while achieving high resource utilization in the data center. Our control system is developed using classical control theory, and we used a black-box system modeling approach to overcome the absence of first principle models for complex enterprise applications and systems. To evaluate our controllers, we built a testbed simulating a virtual data center using Xen virtual machines. We experimented with two multi-tier applications in this virtual data center: a two-tier implementation of RUBiS, an online auction site, and a two-tier Java implementation of TPC-W. Our results indicate that the proposed control system is able to maintain high resource utilization and meets QoS goals in spite of varying resource demands from the applications.

References

[1]

T. F. Abdelzaher, K. G. Shin, and N. Bhatti. Performance guarantees for web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, 13, 2002.

Digital Library

[2]

C. Amza, A. Ch, A. L. Cox, S. Elnikety, R. Gil, K. Rajamani, E. Cecchet, and J. Marguerite. Specification and implementation of dynamic web site benchmarks. In Proceedings of WWC-5: IEEE 5th Annual Workshop on Workload Characterization, October 2002.

[3]

A. Andrzejak, M. Arlitt, and J. Rolia. Bounding the resource savings of utility computing models. Technical Report HPL-2002-339, Hewlett Packard Laboratories

[4]

M. Aron, P. Druschel, and W. Zwaenepoel. Cluster reserves: a mechanism for resource management in cluster-based network servers. In Proceedings of the international conference on Measurement and modeling of computer systems(ACM SIGMETRICS), pages 90--101, 2000.

Digital Library

[5]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP), pages 164--177, October 2003.

Digital Library

[6]

H. W. Cain, R. Rajwar, M. Marden, and Mikko H. Lipasti. An architectural evaluation of java TPC-W. In HPCA, pages 229--240, 2001.

Digital Library

[7]

A. Chandra, W. Gong, and P. Shenoy. Dynamic resource allocation for shared data centers using online measurements. In Proceedings of the Eleventh IEEE/ACM International Workshop on Quality of Service (IWQoS).

Digital Library

[8]

J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP), October 2001.

Digital Library

[9]

Y. Diao, N. Gandhi, J. L. Hellerstein, S. Parekh, and D. M. Tilbury. Mimo control of an apache web server: Modeling and controller design. In Proceedings of American Control Conference (ACC), 2002.

[10]

Y. Diao, J. L. Hellerstein, S. Parekh, R. Griffith, G. E. Kaiser, and D. Phung. A control theory foundation for self-managing computing systems. IEEE journal on selected areas in communications, 23(12):2213--2222, December 2005.

Digital Library

[11]

S. Elnikety, E. Nahum, J. Tracey, and W. Zwaenepoel. A method for transparent admission control and request scheduling in e-commerce web sites. In Proceedings of the 13th international conference on World Wide Web, 2004.

Digital Library

[12]

S. Graupner, J. Pruyne, and S. Singhal. Making the utility data center a power station for the enterprise grid. Technical Report HPL-2003-53, Hewlett Packard Laboratories, March 2003.

[13]

J. L. Hellerstein. Designing in control engineering of computing systems. In Proceedings of American Control Conference, 2004.

[14]

J. L. Hellerstein, Y. Diao, S. Parekh, and D. M. Tilbury. Feedback Control of Computing Systems. IEEE Press/Wiley Interscience, 2004.

Digital Library

[15]

M. B. Jones, D. Rosu, and M-C. Rosu. Cpu reservations and time constraints: efficient, predictable scheduling of independent activities. In Proceedings of the 16th ACM Symposium on Operating System Principles (SOSP), October 1997.

Digital Library

[16]

A. Kamra, V. Misra, and E. Nahum. Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In Proceedings of the International Workshop on Quality of Service (IWQoS), June 2004.

[17]

C. Karamanolis, M. Karlsson, and X. Zhu. Designing controllable computer systems. In Proceedings of the USENIX Workshop on Hot Topics in Operating Systems, pages 49--54, June 2005.

Digital Library

[18]

M. Karlsson, C. Karamanolis, and X. Zhu. Triage: Performance isolation and differentiation for storage systems. In Proceedings of the 12th IEEE International Workshop on Quality of Service (IWQoS), 2004.

[19]

A. Karve, T. Kimbrel, G. Pacifici, M. Spreitzer, M. Steinder, M. Sviridenko, and A. Tantawi. Dynamic placement for clustered web applications. In Proceedings of the 15th International Conference on World Wide Web, pages 595--604, May 2006.

Digital Library

[20]

X. Liu, X. Zhu, S. Singhal, and M. Arlitt. Adaptive entitlement control of resource partitions on shared servers. In Proceedings of the 9th International Symposium on Integrated Network Management, May 2005.

[21]

C. Lu, T. F. Abdelzaher, J. Stankovic, and S. Son. A feedback control approach for guaranteeing relative delays in web servers. In Proceedings of the IEEE Real-Time Technology and Applications Symposium, 2001.

Digital Library

[22]

Y. Lu, T. F. Abdelzaher, and A. Saxena. Design, implementation, and evaluation of differentiated caching serives. IEEE Transactions on Parallel and Distributed Systems, 15(5), May 2004.

Digital Library

[23]

J. Nieh and M. S. Lam. The design, implementation, and evaluation of smart: A scheduler for multimedia applications. In Proceedings of the 16th ACM Symposium on Operating System Principles (SOSP), October 1997.

Digital Library

[24]

J. Rolia, X. Zhu, M. Arlitt, and A. Andrzejak. Statistical service assurances for applications in utility grid environments. Performance Evaluation Journal, 58(2-3), November 2004.

Digital Library

[25]

K. Shen, H. Tang, T. Yang, and L. Chu. Integrated resource management for cluster-based internet services. ACM SIGOPS Operating Systems Review, 36(SI):225--238, 2002.

Digital Library

[26]

D. C. Steere, A. Goel, J. Gruenberg, D. McNamee, C. Pu, and J. Walpole. A feedback-driven proportion allocator for real-rate scheduling. In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation (OSDI), February 1999.

Digital Library

[27]

B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Fifth symposium on operating systems design and implementation (OSDI), pages 239 -- 254, December 2002.

Digital Library

[28]

B. Urgaonkar, P. J. Shenoy, A. Chandra, and P. Goyal. Dynamic provisioning of multi-tier internet applications. In Proceedings of International Conference on Autonomic Computing (ICAC), pages 217--228, 2005.

Digital Library

[29]

C. A. Waldspurger and W. E. Weihl. Lottery scheduling: flexible proprotional-share aresource management. In Proceedings of the 1st Symposium on Operating Systems Design and Implementation (OSDI), November 1994.

Digital Library

[30]

Z. Wang, X. Zhu, and S. Singhal. Utilization and slo-based control for dynamic sizing of resource partitions. Technical Report HPL-2005-126R1, Hewlett Packard Laboratories, Feb 2005.

Digital Library

[31]

Y. Zhang, A. Bestavros, M. Guirguis, I. Matta, and R. West. Friendly virtual machines: leveraging a feedback-control model for application adaptation. In Michael Hind and Jan Vitek, editors, VEE, pages 2--12. ACM, 2005.

Digital Library

[32]

X. Zhu, Z. Wang, and S. Singhal. Utility driven workload management using nested control design. In Proceedings of American Control Conference (ACC), June 2006.

Cited By

Di Stefano AGollo MMorana G(2024)Improving QoS Management Using Associative Memory and Event-Driven Transaction HistoryInformation10.3390/info1509056915:9(569)Online publication date: 18-Sep-2024
https://doi.org/10.3390/info15090569
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_7
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Systeme für skalierbares DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_4(61-90)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_4
Show More Cited By

Index Terms

Adaptive control of virtualized resources in utility computing environments

Recommendations

Adaptive control of virtualized resources in utility computing environments
EuroSys'07 Conference Proceedings

Data centers are often under-utilized due to over-provisioning as well as time-varying resource demands of typical enterprise applications. One approach to increase resource utilization is to consolidate applications in a shared infrastructure using ...
Automated control of multiple virtualized resources
EuroSys '09: Proceedings of the 4th ACM European conference on Computer systems

Virtualized data centers enable sharing of resources among hosted applications. However, it is difficult to satisfy service-level objectives(SLOs) of applications on shared infrastructure, as application workloads and resource consumption patterns ...
Server consolidation with migration control for virtualized data centers

Virtualization has become a key technology for simplifying service management and reducing energy costs in data centers. One of the challenges faced by data centers is to decide when, how, and which virtual machines (VMs) have to be consolidated into a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007

March 2007

431 pages

ISBN:9781595936363

DOI:10.1145/1272996

ACM SIGOPS Operating Systems Review Volume 41, Issue 3
EuroSys'07 Conference Proceedings
June 2007
386 pages
ISSN:0163-5980
DOI:10.1145/1272998
Issue’s Table of Contents

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

EuroSys07

Sponsor:

SIGOPS

EuroSys07: Eurosys 2007 Conference

March 21 - 23, 2007

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 241 of 1,308 submissions, 18%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

432
Total Citations
View Citations
2,665
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)2

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Di Stefano AGollo MMorana G(2024)Improving QoS Management Using Associative Memory and Event-Driven Transaction HistoryInformation10.3390/info1509056915:9(569)Online publication date: 18-Sep-2024
https://doi.org/10.3390/info15090569
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Polyglotte Persistenz im DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_7(161-188)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_7
Gessert FWingerath WRitter NGessert FWingerath WRitter N(2024)Systeme für skalierbares DatenmanagementSchnelles und skalierbares Cloud-Datenmanagement10.1007/978-3-031-54388-3_4(61-90)Online publication date: 3-May-2024
https://doi.org/10.1007/978-3-031-54388-3_4
Ma JLi LXu C(2023)AutoRS: Environment-Dependent Real-Time Scheduling for End-to-End Autonomous DrivingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.332397534:12(3238-3252)Online publication date: Dec-2023
https://doi.org/10.1109/TPDS.2023.3323975
Ma JLi LWang ZWang JXu C(2023)HCPerf: Driving Performance-Directed Hierarchical Coordination for Autonomous Vehicles2023 IEEE 43rd International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS57875.2023.00086(487-498)Online publication date: Jul-2023
https://doi.org/10.1109/ICDCS57875.2023.00086
Kaur GChawla S(2023)Dynamic Resource Allocation Framework in Cloud ComputingSoft Computing and Signal Processing10.1007/978-981-19-8669-7_27(297-306)Online publication date: 27-Jun-2023
https://doi.org/10.1007/978-981-19-8669-7_27
Naik K(2022)An Adaptive Push-Pull for Disseminating Dynamic Workload and Virtual Machine Live Migration in Cloud ComputingInternational Journal of Grid and High Performance Computing10.4018/IJGHPC.30159114:1(1-25)Online publication date: 29-Jun-2022
https://dl.acm.org/doi/10.4018/IJGHPC.301591
Jia WZhang JShan JLi JDing XGavrilovska AAltınbüken DBinnig C(2022)Achieving low latency in public edges by hiding workloads mutual interferenceProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563459(477-492)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3542929.3563459
Wang SHoffmann HLu SRoychoudhury ACadar CKim M(2022)AgileCtrl: a self-adaptive framework for configuration tuningProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3549136(459-471)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3540250.3549136
Makridis EDeliparaschos KKalyvianaki EZolotas ACharalambous T(2022)Robust Dynamic CPU Resource Provisioning in Virtualized ServersIEEE Transactions on Services Computing10.1109/TSC.2020.296697215:2(956-969)Online publication date: 1-Mar-2022
https://doi.org/10.1109/TSC.2020.2966972
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents