More Web Proxy on the site http://driver.im/

research-article

Network support for resource disaggregation in next-generation datacenters

Authors:

Sylvia Ratnasamy,

Scott ShenkerAuthors Info & Claims

HotNets-XII: Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks

Article No.: 10, Pages 1 - 7

https://doi.org/10.1145/2535771.2535778

Published: 21 November 2013 Publication History

Abstract

Datacenters have traditionally been architected as a collection of servers wherein each server aggregates a fixed amount of computing, memory, storage, and communication resources. In this paper, we advocate an alternative construction in which the resources within a server are disaggregated and the datacenter is instead architected as a collection of standalone resources.

Disaggregation brings greater modularity to datacenter infrastructure, allowing operators to optimize their deployments for improved efficiency and performance. However, the key enabling or blocking factor for disaggregation will be the network since communication that was previously contained within a single server now traverses the datacenter fabric. This paper thus explores the question of whether we can build networks that enable disaggregation at datacenter scales.

References

[1]

Apache Hadoop. http://hadoop.apache.org/.

[2]

HP Moonshot System. http://goo.gl/fteii.

[3]

Memcached - a distributed memory object caching system. http://memcached.org/.

[4]

Open Compute Project. http://www.opencompute.org/.

[5]

PigMix benchmark tool. http://cwiki.apache.org/confluence/display/PIG/PigMix.

[6]

SeaMicro Technology Overview. http://seamicro.com/sites/default/files/SM_TO01_64_v2.5.pdf.

[7]

M. Alizadeh, S. Yang, M. Sharif, S. Katti, N. McKeown, B. Prabhakar, and S. Shenker. pFabric: Minimal Near-Optimal Datacenter Transport. In Proc. SIGCOMM, 2013.

Digital Library

[8]

T. E. Anderson, D. E. Culler, and D. Patterson. A case for NOW (networks of workstations). Micro, IEEE, 15(1): 54--64, 1995.

Digital Library

[9]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the Art of Virtualization. In Proc. SOSP, 2003.

Digital Library

[10]

L. A. Barroso, J. Dean, and U. Holzle. Web search for a planet: The Google cluster architecture. Micro, IEEE, 23(2): 22--28, 2003.

Digital Library

[11]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In Proc. SoCC, 2010.

Digital Library

[12]

A. Greenberg, G. Hjalmtysson, D. A. Maltz, A. Myers, J. Rexford, G. Xie, H. Yan, J. Zhan, and H. Zhang. A clean slate 4D approach to network control and management. ACM SIGCOMM Computer Communication Review, 35(5): 41--54, 2005.

Digital Library

[13]

N. Gude, T. Koponen, J. Pettit, B. Pfaff, M. Casado, N. McKeown, and S. Shenker. Nox: towards an operating system for networks. ACM SIGCOMM Computer Communication Review, 38(3): 105--110, 2008.

Digital Library

[14]

B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. In Proc. NSDI, 2011.

Digital Library

[15]

Intel Newsroom. Intel, Facebook Collaborate on Future Data Center Rack Technologies. http://newsroom.intel.com/community/intel_newsroom/blog/2013/01/16/intel-facebook-collaborate-on-future-data-center-rack-technologies.

[16]

K. Lim and J. Chang and T. Mudge and P. Ranganathan and S. K. Reinhardt and T. F. Wenisch. Disaggregated Memory for Expansion and Sharing in Blade Servers. In Proc. ISCA, 2009.

Digital Library

[17]

K. Lim and Y. Turner and J. R. Santos and A. AuYoung and J. Chang and P. Ranganathan and T. F. Wenisch. System-level implications of disaggregated memory. In Proc. HPCA, 2012.

Digital Library

[18]

Kshitij Sudan, Saisanthosh Balakrishnan, Sean Lie, Min Xu, Dhiraj Mallick, Gary Lauterbach, and Rajeev Balasubramonian. A Novel System Architecture for Web Scale Applications Using Lightweight CPUs and Virtualized I/O. In Proc. HPCA, 2013.

Digital Library

[19]

Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M. Hellerstein. Graphlab: A new framework for parallel machine learning. 2010.

[20]

C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In Proc. SIGMOD, 2008.

Digital Library

[21]

L. Popa, G. Kumar, M. Chowdhury, A. Krishnamurthy, S. Ratnasamy, and I. Stoica. FairCloud: sharing the network in cloud computing. In Proc. SIGCOMM, 2012.

Digital Library

[22]

L. Popa, P. Yalagandula, S. Banerjee, J. C. Mogul, and Y. T. J. R. Santos. ElasticSwitch: Practical Work-Conserving Bandwidth Guarantees for Cloud Computing. In Proc. SIGCOMM, 2013.

Digital Library

[23]

C. Reiss, J. Wilkes, and J. L. Hellerstein. Google cluster-usage traces: format + schema. Technical report, Google Inc., Mountain View, CA, USA, Nov. 2011. Revised 2012.03.20. Posted at URL http://code.google.com/p/googleclusterdata/wiki/TraceVersion2.

[24]

S. Rumble, D. Ongaro, R. Stutsman, M. Rosenblum, and J. Ousterhout. It's time for low latency. In Proc. HotOS, 2011.

Digital Library

[25]

A. Shieh, S. Kandula, A. Greenberg, and C. Kim. Seawall: performance isolation for cloud datacenter networks. In Proc. HotCloud, 2010.

Digital Library

[26]

S. Soltesz, H. Pötzl, M. E. Fiuczynski, A. Bavier, and L. Peterson. Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors. In Proc. EuroSys, 2007.

Digital Library

[27]

B. C. Vattikonda, G. Porter, A. Vahdat, and A. C. Snoeren. Practical TDMA for datacenter Ethernet. In Proc. EuroSys, 2012.

Digital Library

Cited By

Ikoma AOhsita YMurata M(2024)Optical network topology design to execute many tasks simultaneously in a disaggregated data centerJournal of Optical Communications and Networking10.1364/JOCN.52462816:7(764)Online publication date: 25-Jun-2024
https://doi.org/10.1364/JOCN.524628
Luo XZuo PShen JGu JWang XLyu MZhou Y(2024)A Memory-Disaggregated Radix TreeACM Transactions on Storage10.1145/366428920:3(1-41)Online publication date: 6-Jun-2024
https://dl.acm.org/doi/10.1145/3664289
Liao YWu JLu WLi XYan G(2024)DPU-Direct: Unleashing Remote Accelerators via Enhanced RDMA for Disaggregated DatacentersIEEE Transactions on Computers10.1109/TC.2024.340408973:8(2081-2095)Online publication date: Aug-2024
https://doi.org/10.1109/TC.2024.3404089
Show More Cited By

Index Terms

Network support for resource disaggregation in next-generation datacenters
1. Networks
  1. Network architectures

Recommendations

Network requirements for resource disaggregation
OSDI'16: Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation

Traditional datacenters are designed as a collection of servers, each of which tightly couples the resources required for computing tasks. Recent industry trends suggest a paradigm shift to a disaggregated datacenter (DDC) architecture containing a pool ...
An energy, performance efficient resource consolidation scheme for heterogeneous cloud datacenters
Abstract
Datacenters are the principal electricity consumers for cloud computing that provide an IT backbone for today's business and economy. Numerous studies suggest that most of the servers, in the US datacenters, are idle or less-utilised, ...
Highlights
- A consolidation method is suggested to manage datacenter resources – particularly, when container run inside VMs.
Distributed Autonomous Virtual Resource Management in Datacenters Using Finite-Markov Decision Process

To provide robust infrastructure as a service, clouds currently perform load balancing by migrating virtual machines VMs from heavily loaded physical machines PMs to lightly loaded PMs. Previous reactive load balancing algorithms migrate VMs upon the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets-XII: Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks

November 2013

188 pages

ISBN:9781450325967

DOI:10.1145/2535771

General Chair:
Dave Levine
UMD
,
Program Chairs:
Sachin Katti
Stanford University
,
Dave Oran
Cisco

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

HotNets-XII

Sponsor:

SIGCOMM

HotNets-XII: Twelfth ACM Workshop on Hot Topics in Networks

November 21 - 22, 2013

Maryland, College Park

Acceptance Rates

HotNets-XII Paper Acceptance Rate 26 of 110 submissions, 24%;

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

124
Total Citations
View Citations
985
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)8

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ikoma AOhsita YMurata M(2024)Optical network topology design to execute many tasks simultaneously in a disaggregated data centerJournal of Optical Communications and Networking10.1364/JOCN.52462816:7(764)Online publication date: 25-Jun-2024
https://doi.org/10.1364/JOCN.524628
Luo XZuo PShen JGu JWang XLyu MZhou Y(2024)A Memory-Disaggregated Radix TreeACM Transactions on Storage10.1145/366428920:3(1-41)Online publication date: 6-Jun-2024
https://dl.acm.org/doi/10.1145/3664289
Liao YWu JLu WLi XYan G(2024)DPU-Direct: Unleashing Remote Accelerators via Enhanced RDMA for Disaggregated DatacentersIEEE Transactions on Computers10.1109/TC.2024.340408973:8(2081-2095)Online publication date: Aug-2024
https://doi.org/10.1109/TC.2024.3404089
Ng DLin AKashyap ALi GLu X(2024)NVMe-oPF: Designing Efficient Priority Schemes for NVMe-over-Fabrics with Multi-Tenancy Support2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS57955.2024.00052(519-531)Online publication date: 27-May-2024
https://doi.org/10.1109/IPDPS57955.2024.00052
Xu YYu JGuo HLi JWu W(2024)A Distributed State Management Approach for FaaS Platforms2024 9th International Conference on Computer and Communication Systems (ICCCS)10.1109/ICCCS61882.2024.10603351(1306-1312)Online publication date: 19-Apr-2024
https://doi.org/10.1109/ICCCS61882.2024.10603351
Baziana P(2024)Optical Data Center Networking: A Comprehensive Review on Traffic, Switching, Bandwidth Allocation, and ChallengesIEEE Access10.1109/ACCESS.2024.351321412(186413-186444)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3513214
Ikoma AOhsita YMurata M(2024)Resource Allocation Considering Impact of Network on Performance in a Disaggregated Data CenterIEEE Access10.1109/ACCESS.2024.339993012(67600-67618)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3399930
Yan BLu YWang QXie MShu JNaor DGoel A(2023)PatronusProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585958(315-330)Online publication date: 21-Feb-2023
https://dl.acm.org/doi/10.5555/3585938.3585958
Xiao YXie XLi QQiao XGu W(2023)SPANoF: A Scalable and Performant Architecture for NVMeoF-Based Storage Disaggregation with Limited Network ResourcesElectronics10.3390/electronics1213280212:13(2802)Online publication date: 25-Jun-2023
https://doi.org/10.3390/electronics12132802
Chen XYu LLiu VZhang QSchulzrinne HKohler EMaltz DMisra V(2023)Cowbird: Freeing CPUs to Compute by Offloading the Disaggregation of MemoryProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604833(1060-1073)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604833
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents