Abstract
Power-efficient operation is a desirable property, particularly for large clusters housed in datacenters. Recent work has advocated turning off entire nodes to achieve power-proportionality, but this leads to problems with availability and fault tolerance because of the resulting limits imposed on the replication strategies used by the distributed file systems (DFS) employed in these environments, with counter-measures adding substantial complexity to DFS designs. To achieve power-efficiency for a cluster without impacting data availability and recovery from failures and maintain simplicity in DFS design, our solution exploits cluster nodes that have the ability to operate in at least two extreme system level power states, characterized by minimum vs. maximum power consumption and performance. The paper describes a cluster built with power-efficient node prototypes and presents experimental evaluations to demonstrate power-efficiency.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hadoop, http://hadoop.apache.org
Phidgets Inc., http://www.phidgets.com
Adiletta, M., Rosenbluth, M., Bernstein, D., Wolrich, G., Wilkinson, H.: The next generation of intel ixp network processors. Intel Technology Journal 6 (2002)
Agarwal, Y., Hodges, S., Scott, J., Chandra, R., Bahl, P., Gupta, R.: Somniloquy: Augmenting Network Interfaces to Reduce PC Energy Usage. In: NSDI 2009 (2009)
Amur, H., Cipar, J., Gupta, V., Ganger, G.R., Kozuch, M.A., Schwan, K.: Robust And Flexible Power-proportional Storage. In: SOCC 2010: Proceedings of the First ACM Symposium on Cloud Computing (2010)
Anagnostopoulou, V., Biswas, S., Savage, A., Bianchini, R., Yang, T., Chong, F.T.: Energy Conservation in Datacenters through Cluster Memory Management and Barely-Alive Memory Servers. In: WEED 2009 (2009)
Andersen, D.G., Franklin, J., Kaminsky, M., Phanishayee, A., Tan, L., Vasudevan, V.: FAWN: A Fast Array of Wimpy Nodes. In: SOSP 2009: Proceedings of the 22nd ACM Symposium on Operating Systems Principles (2009)
Barroso, L.A., Hölzle, U.: The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines (2009)
Chase, J.S., Anderson, D.C., Thakar, P.N., Vahdat, A.M., Doyle, R.P.: Managing energy and server resources in hosting centers. SIGOPS Oper. Syst. Rev. (2001)
Ghemawat, S., Gobioff, H., Leung, S.T.: The Google File System. SIGOPS Oper. Syst. Rev. 37(5), 29–43 (2003)
Hamilton, J., Treadwell, D.: Resource consumption shaping (2008)
Leverich, J., Kozyrakis, C.: On the energy (in)efficiency of hadoop clusters. In: HotPower 2009, co-located with SOSP 2009 (2009)
Meisner, D., Gold, B.T., Wenisch, T.F.: Powernap: eliminating server idle power. In: ASPLOS 2009: Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (2009)
Pinheiro, E., Weber, W.D., Barroso, L.A.: Failure trends in a large disk drive population. In: FAST 2007: Proceedings of the 5th USENIX Conference on File and Storage Technologies (2007)
Thereska, E., Donnelly, A., Narayanan, D.: Sierra: a power-proportional, distributed storage system. Tech. rep., Microsoft Research (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Amur, H., Schwan, K. (2011). Achieving Power-Efficiency in Clusters without Distributed File System Complexity. In: Varbanescu, A.L., Molnos, A., van Nieuwpoort, R. (eds) Computer Architecture. ISCA 2010. Lecture Notes in Computer Science, vol 6161. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24322-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-24322-6_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24321-9
Online ISBN: 978-3-642-24322-6
eBook Packages: Computer ScienceComputer Science (R0)