[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2494621.2494624acmotherconferencesArticle/Chapter ViewAbstractPublication PagescacConference Proceedingsconference-collections
research-article

Autonomic performance-per-watt management (APM) of cloud resources and services

Published: 09 August 2013 Publication History

Abstract

With the rapid growth of data centers and clouds, the power cost and power consumption of their computing and storage resources become critically important to be managed efficiently. Several research studies have shown that data servers typically operate at a low utilization of 10% to 15%, while their power consumption is close to those at peak loads. With this significant fluctuation in the workloads, an elastic delivery of computing services with an efficient power provisioning mechanism becomes an important design goal. Live workload migrations and virtualization are important techniques to optimize power and performance in large-scale data centers [5], [25] This paper presents an application specific autonomic adaptive power and performance management system that utilizes AppFlow-based reasoning to configure dynamically datacenter resources and workload allocations. This system will continuously monitor the workload to determine the current operating point of both workloads and the virtual machines (VMs) running these workloads and then predict the next operating points for these VMs. This enables the system to allocate the appropriate amount of hardware resources that can run efficiently the VM workloads with minimum power consumption. We have experimented with and evaluated our approach to manage the VMs running RUBiS bidding application. Our experimental results showed that our approach can reduce the VMs' power consumption up to 84% compared to static resource allocation and up to 30% compared to other methods with minimum performance degradation.

References

[1]
Liu, H., Xu, C. Z., Jin, H., Gong, J., and Liao, X. 2011. Performance and energy modeling for live migration of virtual machines. In Proceedings of the 20th international symposium on High performance distributed computing (HPDC'11). ACM, New York, NY, USA, 171--182.
[2]
Khargharia, B., Luo, H., Al-Nashif, Y., and Hariri, S. 2010. AppFlow-based Autonomic Performance-per-Watt Management of Large-Scale Data Centers. The 2010 IEEE/ACM International Conference on Green Computing and Communications (GreenCom-2010), Hangzhou, China, December 2010.
[3]
Brill, K. G. 2007. The Invisible Crisis in the Data Center: The Economic Meltdown of Moore's Law. White paper by the Uptime Institute
[4]
Likhachev, M., Arkin. R. C. 2011. Spatio-Temporal Case-Based Reasoning for Behavioral Selection, Proceedings 2001 ICRA. IEEE International Conference on, vol.2, no., pp.1627, 1634 vol.2, 2001
[5]
Beloglazov, A. and Buyya, R. 2010. Energy efficient allocation of virtual machines in cloud data centers. 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid), IEEE, 2010, pp. 577--578.
[6]
Chan, H., Connell, J., Isci, C., Kephart, J. O., Lenchner, J., Mansley, C., and McIntosh, S. 2011. A robot as mobile sensor and agent in data center energy management. In Proceedings of the 8th ACM international conference on Autonomic computing (ICAC '11). ACM, New York, NY, USA, 165--166.
[7]
Zhang, H., Yoshihira, K., Su, Y.-Y., Jiang, G., Chen, M., and Wang, X. 2011. iPOEM: A GPS tool for integrated management in virtualized data centers. Proceedings of the 8th ACM International Conference on Autonomic Computing, ICAC'11 and Co-located Workshops, pp. 41--50.
[8]
Kotera, I., Abe, K., Egawa, R., Takizawa, H., and Kobayashi H. 2011. Power-aware dynamic cache partitioning for cmps, Transactions on HiPEAC III, LNCS 6590, pp. 135--153, 2011
[9]
Wang, X. and Wang, Y. 2011. Coordinating Power Control and Performance Management for Virtualized Server Clusters. IEEE Transactions on Parallel and Distributed Systems, vol.22, no.2, pp.245, 259, Feb. 2011
[10]
Bohrer, P., Elnozahy, E. N., Keller, T., Kistler, M., Lefurgy, C., McDowell, C., and Rajamony, R. 2002. The case for power management in web servers. In Power aware computing, Robert Graybill and Rami Melhem (Eds.). Kluwer Academic Publishers, Norwell, MA, USA 261--289.
[11]
Brown, R. 2008. Report to congress on server and data center energy efficiency: Public law 109--431.
[12]
David, H., Fallin, C., Gorbatov, E., Hanebutte, U. R., and Mutlu, O. 2011. Memory power management via dynamic voltage/frequency scaling. In Proceedings of the 8th ACM international conference on Autonomic computing (ICAC '11). ACM, New York, NY, USA, 31--40.
[13]
Cochran, R., Hankendi, C., Coskun, A., and Reda, S. 2011. Pack & cap: Adaptive dvfs and thread packing under power caps. Proceedings of the 2011 44th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO '44, pages 175--185, Washington, DC, USA, 2011.
[14]
Cohen, W. W. 1995. Fast Effective Rule Induction. In Proceedings of the Twelfth International Conference on Machine Learning, Lake Tahoe, California.
[15]
Hsu, C. and Feng, W. 2005. Effective Dynamic Voltage Scaling through CPU-Boundedness Detection. In Lecture Notes in Computer Science, February 2005. LA-UR 04-7195
[16]
Heller, B., Seetharaman, S., Mahadevan, P., Yiakoumis, Y., Sharma, P., Banerjee, S., and McKeown, N. 2010. ElasticTree: saving energy in data center networks. In Proceedings of the 7th USENIX conference on Networked systems design and implementation(NSDI'10). USENIX Association, Berkeley, CA, USA, 17--17.
[17]
Xu, M., Shang, Y., Li, D., and Wang, X. 2012. Greening data center networks with throughput-guaranteed power-aware routing. Computer Networks, 28 December 2012, ISSN 1389-1286, 10.1016/j.comnet.2012.12.012
[18]
Li, Z., Greenan, K. M., and Leung, A. W. 2012. Power Consumption in Enterprise-Scale Backup Storage Systems, Proceedings of the Tenth USENIX Conference on File and Storage Technologies (FAST '12)
[19]
Gandhi, A., Chen, Y., Gmach, D., Arlitt, M., and Marwah, M. 2011. Minimizing data center SLA violations and power consumption via hybrid resource provisioning. In Proceedings of the 2011 International Green Computing Conference and Workshops (IGCC '11). IEEE Computer Society, Washington, DC, USA, 1--8.
[20]
Beloglazov, A. and Buyya, R. 2010. Energy Efficient Resource Management in Virtualized Cloud Data Centers. In Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGRID '10). IEEE Computer Society, Washington, DC, USA, 826--831.
[21]
Ananthanarayanan, G. and Katz, R. H. 2008. Greening the switch. In Proceedings of the 2008 conference on Power aware computing and systems (HotPower'08).
[22]
Weddle, C., Oldham, M., Qian, J., Wang, A. A., Reiher, P., and Kuenning, G. 2007. PARAID: A gear-shifting power-aware RAID. In Proceedings of the Fifth USENIX Conference on File and Storage Technologies (FAST '07), pages 245--260, San Jose, CA, February 2007.
[23]
Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping Disk Arrays Sleep Through the Winter. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP '05), pages 177--190, Brighton, UK, October 2005.
[24]
Wang, X. and Chen, M. 2008. Cluster-level feedback power control for performance optimization. IEEE 14th International Symposium on High Performance Computer Architecture, 2008. pp.101--110, 16-20 Feb. 2008
[25]
Niles, S. and Donovan, P. 2011. Virtualization and Cloud Computing: Optimized Power, Cooling, and Management Maximizes Benefits. White paper 118. Revision 3, Schneider Electric, 2011.
[26]
Miyoshi, A., Lefurgy, C., Van Hensbergen, E., Rajamony, R., Rajkumar, R. 2002. Critical power slope: understanding the runtime effects of frequency scaling. Proceedings of the 16th international conference on Supercomputing, New York, USA.
[27]
Elnozahy, E. N., Kistler, M., Rajamony, R. 2002. Energy-Efficient Server Clusters. In Proceedings of the 2nd Workshop on Power-Aware Computing Systems.
[28]
Pinheiro, E., Bianchini, R., Carrera, E. V., and Heath, T. 2001. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. Proceedings of the Workshop on Compilers and Operating Systems for Low Power, September 2001; Technical Report DCS-TR-440, Department of Computer Science, Rutgers University, New Brunswick, NJ, May 2001.
[29]
Sharma, V., Thomas, A., Abdelzaher,T., K. Skadron, Z. Lu, Power-aware QoS Management in Web Servers, Proceedings of the 24th IEEE International Real-Time Systems Symposium, p.63, December 03-05, 2003
[30]
Berral, J. Ll., Goiri, I., Nou, R., Julia, F., Guitart J., Gavalda R., and Torres, J. 2010. Towards energy-aware scheduling in data centers using machine learning. In Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking (e-Energy '10). ACM, New York, NY, USA, 215--224.
[31]
Lebeck, A. R., Fan, X., Zeng, H., and Ellis, C. 2000. Power Aware Page Allocation. In ASPLOS, pages 105--116.
[32]
Cai, Le., Lu, Yung-Hsiang. 2005. Joint Power Management of Memory and Disk. Design, Automation and Test in Europe (DATE'05), vol. 1, pp.86--91
[33]
Felter, W., Rajamani, K., Keller, T. (IBM ARL)., and C. Rusu. 2005. A Performance-Conserving Approach for Reducing Peak Power Consumption in Server Systems, ACM International Conference on Supercomputing (ICS), Cambridge, MA.
[34]
Srivastava, M., Chandrakasan, A., and Brodersen, R. 1996. Predictive system shutdown and other architectural techniques for energy efficient programmable computation. IEEE Trans. VLSI Systems, Vol. 4.
[35]
Paleologo., Benini, L., Bogliolo, A., and De Micheli, G. Jun. 1999. Policy optimization for dynamic power management. IEEE Trans. Computer-Aided Design, Vol. 18, pp. 813--33.
[36]
Xen, 2013. Xen Hypervisor. Accessed March 25, 2013 from http://www.xen.org/.
[37]
OW2, 2013. RUBiS Benchmark. Accessed March 25, 2013 from http://rubis.ow2.org/
[38]
PostgreSQL, 2013. Postgres Data base. Accessed March 25, 2013 from http://www.postgresql.org/
[39]
Hall, Mark., Frank, Eibe., Holmes, Geoffrey., Pfahringer, Bernhard., Reutemann, Peter., and Witten, I. H. 2009. The WEKA Data Mining Software: An Update. SIGKDD Explorations, Volume 11, Issue 1.

Cited By

View all
  • (2019)CONCORD: Improving Communication using Consumer-Count Detection2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA47632.2019.9035220(1-11)Online publication date: Nov-2019
  • (2019)Autonomic Resource Management for Power, Performance, and Security in Cloud Environment2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA47632.2019.9035213(1-4)Online publication date: Nov-2019
  • (2017)Autonomic Fall Detection System2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2017.142(166-170)Online publication date: Sep-2017
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
CAC '13: Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference
August 2013
247 pages
ISBN:9781450321723
DOI:10.1145/2494621
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • University of Arizona: University of Arizona
  • OGF: Open Grid Forum
  • Florida Intl University: Florida International Univeristy

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 August 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AppFlow based reasoning
  2. performance-per-watt
  3. power and performance management
  4. workload characterization

Qualifiers

  • Research-article

Funding Sources

Conference

CAC '13
Sponsor:
  • University of Arizona
  • OGF
  • Florida Intl University
CAC '13: ACM Cloud and Autonomic Computing Conference
August 5 - 9, 2013
Florida, Miami, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 31 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2019)CONCORD: Improving Communication using Consumer-Count Detection2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA47632.2019.9035220(1-11)Online publication date: Nov-2019
  • (2019)Autonomic Resource Management for Power, Performance, and Security in Cloud Environment2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA47632.2019.9035213(1-4)Online publication date: Nov-2019
  • (2017)Autonomic Fall Detection System2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2017.142(166-170)Online publication date: Sep-2017
  • (2017)Autonomic Cross-Layer Management of Cloud Systems2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2017.141(160-165)Online publication date: Sep-2017
  • (2017)Value of service based resource management for large-scale computing systemsCluster Computing10.1007/s10586-017-0901-920:3(2013-2030)Online publication date: 1-Sep-2017
  • (2016)Value-Based Resource Management in High-Performance Computing SystemsProceedings of the ACM 7th Workshop on Scientific Cloud Computing10.1145/2913712.2913716(19-26)Online publication date: 1-Jun-2016
  • (2016)Value of Service Based Task Scheduling for Cloud Computing Systems2016 International Conference on Cloud and Autonomic Computing (ICCAC)10.1109/ICCAC.2016.22(1-11)Online publication date: Sep-2016
  • (2016)Just In Time Architecture (JITA) for dynamically composable data centers2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA)10.1109/AICCSA.2016.7945778(1-8)Online publication date: Nov-2016
  • (2016)Joint-analysis of performance and energy consumption when enabling cloud elasticity for synchronous HPC applicationsConcurrency and Computation: Practice & Experience10.1002/cpe.371028:5(1548-1571)Online publication date: 10-Apr-2016
  • (2015)QoS-Aware Autonomic Resource Management in Cloud ComputingACM Computing Surveys10.1145/284388948:3(1-46)Online publication date: 22-Dec-2015
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media