More Web Proxy on the site http://driver.im/

research-article

Public Access

P-FatTree: A multi-channel datacenter network topology

Authors:

William M. Mellette,

Alex C. Snoeren,

George PorterAuthors Info & Claims

HotNets '16: Proceedings of the 15th ACM Workshop on Hot Topics in Networks

Pages 78 - 84

https://doi.org/10.1145/3005745.3005746

Published: 09 November 2016 Publication History

Abstract

The bandwidth and latency requirements of next-generation datacenter networks stress the limits of CMOS manufacturing. A key trend in their design will be a move from single-channel links and switches to multi-channel links and switches. Today's network topologies erase this distinction, providing the illusion of a unified network fabric. In this work we propose P-FatTree, which is a FatTree topology designed specifically for the future multi-channel reality. P-FatTree requires fewer switch chips and as a result has lower cost, power consumption, and latency than existing approaches. Furthermore, by embracing the parallel nature of the network itself, it enables compelling new ways to better manage and deliver application traffic.

References

[1]

25/50G Ethernet Consortium. 25 and 50g ethernet specification, ver 1.4. http://25gethernet.org/.

[2]

M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity, data center network architecture. In Proceedings of the ACM SIGCOMM Conference, Seattle, WA, Aug. 2008.

Digital Library

[3]

M. Alizadeh, S. Yang, M. Sharif, S. Katti, N. McKeown, B. Prabhakar, and S. Shenker. pFabric: Minimal near-optimal datacenter transport. In Proceedings of the ACM SIGCOMM Conference, Hong Kong, China, Aug. 2013.

Digital Library

[4]

M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the clouds: A Berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, UC Berkeley, Feb 2009.

[5]

CDFP MSA. CDFP 400 Gb/s MSA Consortium. http://www.cdfp-msa.com/.

[6]

P.-C. Chiang, H.-W. Hung, H.-Y. Chu, G.-S. Chen, and J. Lee. 2.3 60Gb/s NRZ and PAM4 transmitters for 400GbE in 65nm CMOS. In 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC), pages 42–43. IEEE, 2014.

[7]

C. Clos. A Study of Non-blocking Switching Networks. Bell System Technical Journal, 32(2), 1953.

[8]

J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proceedings of the 6th Conference on Symposium on Opearting Systems Design & Implementation - Volume 6, pages 10–10, Berkeley, CA, USA, 2004. USENIX Association.

Digital Library

[9]

Ethernet Alliance. 2016 Ethernet Roadmap. http://www.ethernetalliance.org/roadmap/.

[10]

Facebook. Introducing "6-pack": the first open hardware modular switch. https://code.facebook.com/posts/717010588413497/introducing-6-pack-the-first-open-hardware-modular-switch/.

[11]

Facebook. Introducing data center fabric. https://code.facebook.com/posts/360346274145943/introducing-data-center-fabric-the-next-generation-facebook-data-center-network/.

[12]

N. Farrington, G. Porter, S. Radhakrishnan, H. H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat. Helios: A hybrid electrical/optical switch architecture for modular data centers. In Proceedings of the ACM SIGCOMM Conference, New Delhi, India, Aug. 2010.

Digital Library

[13]

P. X. Gao, A. Narayan, G. Kumar, R. Agarwal, S. Ratnasamy, and S. Shenker. pHost: Distributed near-optimal datacenter transport over commodity network fabric. In Proceedings of ACM CoNEXT, Heidelberg, Germany, Dec. 2015.

Digital Library

[14]

A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. VL2: A scalable and flexible data center network. Commun. ACM, 54(3):95–104, Mar. 2011.

Digital Library

[15]

M. P. Grosvenor, M. Schwarzkopf, I. Gog, R. N. M. Watson, A. W. Moore, S. Hand, and J. Crowcroft. Queues don't matter when you can jump them! In Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation, NSDI'15, pages 1–14, Berkeley, CA, USA, 2015. USENIX Association.

Digital Library

[16]

IEEE. 802.1Qbp - equal cost multiple paths. http://www.ieee802.org/1/pages/802.1bp.html.

[17]

IEEE 802.3bs. Adopted changes to 802.3bs project objectives. http://www.ieee802.org/3/bs/NGOATH_3bs_Objectives_16_0122.pdf.

[18]

IEEE P802.3bs. 400 gb/s 100m MMF reach objective draft baseline proposal. http://www.ieee802.org/3/bs/public/14_11/king_3bs_02a_1114.pdf.

[19]

IEEE P802.3bs - 400GbE Task Force Meeting. http://www.ieee802.org/3/bs/public/14_11/healey_3bs_01_1114.pdf.

[20]

V. Jeyakumar, M. Alizadeh, D. Mazières, B. Prabhakar, C. Kim, and A. Greenberg. EyeQ: Practical network performance isolation at the edge. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, NSDI'13, pages 297–312, Berkeley, CA, USA, 2013. USENIX Association.

Digital Library

[21]

V. Liu, D. Halperin, A. Krishnamurthy, and T. Anderson. F10: A fault-tolerant engineered network. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, NSDI'13, pages 399–412, Berkeley, CA, USA, 2013. USENIX Association.

Digital Library

[22]

Mellanox. ConnectX-5 EN. http://www.mellanox.com/page/products_dyn?product_family=260&mtag=connectx_5_en_card.

[23]

Memcached. Memcached. http://www.memcached.org/.

[24]

R. N. Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat. Portland: A scalable fault-tolerant layer 2 data center network fabric. In Proceedings of the ACM SIGCOMM Conference, Barcelona, Spain, Aug. 2009.

Digital Library

[25]

G. Porter, R. Strong, N. Farrington, A. Forencich, P. Chen-Sun, T. Rosing, Y. Fainman, G. Papen, and A. Vahdat. Integrating microsecond circuit switching into the data center. In Proceedings of the ACM SIGCOMM Conference, Hong Kong, China, Aug. 2013.

Digital Library

[26]

C. Raiciu, S. Barre, C. Pluntke, A. Greenhalgh, D. Wischik, and M. Handley. Improving datacenter performance and robustness with multipath TCP. In Proceedings of the ACM SIGCOMM Conference, Toronto, Ontario, Canada, Aug. 2011.

Digital Library

[27]

J. Sherry, S. Hasan, C. Scott, A. Krishnamurthy, S. Ratnasamy, and V. Sekar. Making middleboxes someone else's problem: Network processing as a cloud service. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, Helsinki, Finland, Aug. 2012.

Digital Library

[28]

A. Singh, J. Ong, A. Agarwal, G. Anderson, A. Armistead, R. Bannon, S. Boving, G. Desai, B. Felderman, P. Germano, A. Kanagala, J. Provost, J. Simmons, E. Tanda, J. Wanderer, U. Hölzle, S. Stuart, and A. Vahdat. Jupiter rising: A decade of Clos topologies and centralized control in Google's datacenter network. In Proceedings of the ACM SIGCOMM Conference, London, United Kingdom, Aug. 2015.

Digital Library

[29]

A. Vahdat, M. Al-Fares, N. Farrington, R. N. Mysore, G. Porter, and S. Radhakrishnan. Scale-out networking in the data center. IEEE MICRO, 30(4):29–41, Aug. 2010.

Digital Library

[30]

M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, NSDI'12, pages 2–2, Berkeley, CA, USA, 2012. USENIX Association.

Digital Library

Cited By

Kabashkin I(2024)Algorithms of Cross-Domain Redundancy Management for Resilient of Dual-Priority Critical Communication SystemsAlgorithms10.3390/a1709038617:9(386)Online publication date: 2-Sep-2024
https://doi.org/10.3390/a17090386
Mellette WForencich AAthapathu RSnoeren APapen GPorter GSekar VYu MSeneviratne AVeitch D(2024)Realizing RotorNet: Toward Practical Microsecond Scale Optical NetworkingProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672273(392-414)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672273
Wang JZhao GXu HWang H(2024)Leaf: Improving QoS for Reconfigurable Datacenters with Multiple Optical Circuit Switches2024 IEEE/ACM 32nd International Symposium on Quality of Service (IWQoS)10.1109/IWQoS61813.2024.10682931(1-10)Online publication date: 19-Jun-2024
https://doi.org/10.1109/IWQoS61813.2024.10682931
Show More Cited By

P-FatTree: A multi-channel datacenter network topology
1. Networks

Recommendations

P-NoC: Performance Evaluation and Design Space Exploration of NoCs for Chip Multiprocessor Architecture Using FPGA
Abstract
The network-on-chip (NoC) has emerged as an efficient and scalable communication fabric for chip multiprocessors (CMPs) and multiprocessor system on chips (MPSoCs). The NoC architecture, the routers micro-architecture and links influence the ...
Minimizing Energy Consumption of FatTree Data Center Networks

Many data centers are built using a fat-tree network topology because of its high bisection bandwidth. Therefore thereis a need to develop analytical models for the energy behavior of fat-tree networks and examine strategies to reduce energy ...
P-Socket: optimizing a communication library for a PCIe-based intra-rack interconnect
CF '16: Proceedings of the ACM International Conference on Computing Frontiers

Data centers require efficient, low-cost, flexible interconnects to manage the rapidly growing internal traffic generated by an increasingly diverse set of applications. To meet these requirements, data center networks are increasingly employing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '16: Proceedings of the 15th ACM Workshop on Hot Topics in Networks

November 2016

217 pages

ISBN:9781450346610

DOI:10.1145/3005745

General Chair:
Ellen Zegura
Georgia Tech
,
Program Chairs:
Bryan Ford
EPFL
,
Alex C. Snoeren
UC San Diego

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

HotNets-XV

Sponsor:

SIGCOMM

HotNets-XV: The 15th ACM Workshop on Hot Topics in Networks

November 9 - 10, 2016

GA, Atlanta, USA

Acceptance Rates

HotNets '16 Paper Acceptance Rate 30 of 108 submissions, 28%;

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
898
Total Downloads

Downloads (Last 12 months)246
Downloads (Last 6 weeks)77

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kabashkin I(2024)Algorithms of Cross-Domain Redundancy Management for Resilient of Dual-Priority Critical Communication SystemsAlgorithms10.3390/a1709038617:9(386)Online publication date: 2-Sep-2024
https://doi.org/10.3390/a17090386
Mellette WForencich AAthapathu RSnoeren APapen GPorter GSekar VYu MSeneviratne AVeitch D(2024)Realizing RotorNet: Toward Practical Microsecond Scale Optical NetworkingProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672273(392-414)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672273
Wang JZhao GXu HWang H(2024)Leaf: Improving QoS for Reconfigurable Datacenters with Multiple Optical Circuit Switches2024 IEEE/ACM 32nd International Symposium on Quality of Service (IWQoS)10.1109/IWQoS61813.2024.10682931(1-10)Online publication date: 19-Jun-2024
https://doi.org/10.1109/IWQoS61813.2024.10682931
Deresa K(2023)Bi-Objective Optimization of Bandwidth Resources and Energy Consumption for Efficient Virtual Machine Placement in Cloud ComputingSSRN Electronic Journal10.2139/ssrn.4651157Online publication date: 2023
https://doi.org/10.2139/ssrn.4651157
Dai WFoerster KFuchssteiner DSchmid S(2023)Load-optimization in Reconfigurable Data-center Networks: Algorithms and Complexity of Flow RoutingACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/35972008:3(1-30)Online publication date: 18-Jul-2023
https://dl.acm.org/doi/10.1145/3597200
Guo YMellette WSnoeren APorter GBianchi GMei A(2022)Scaling beyond packet switch limits with multiple dataplanesProceedings of the 18th International Conference on emerging Networking EXperiments and Technologies10.1145/3555050.3569141(214-231)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3555050.3569141
Yuqing ZNiwa NAmano H(2022)Distance Aware Compression for Low Latency High Bandwidth Interconnection Network2022 IEEE 15th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC)10.1109/MCSoC57363.2022.00063(361-367)Online publication date: Dec-2022
https://doi.org/10.1109/MCSoC57363.2022.00063
Ben Yoo S(2022)Prospects and Challenges of Photonic Switching in Data Centers and Computing SystemsJournal of Lightwave Technology10.1109/JLT.2021.313657040:8(2214-2243)Online publication date: 15-Apr-2022
https://doi.org/10.1109/JLT.2021.3136570
Mukerjee MCanel CWang WKim DSeshan SSnoeren ABhagwan RPorter G(2020)Adapting TCP for reconfigurable datacenter networksProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388290(651-666)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388290
Mellette WDas RGuo YMcGuinness RSnoeren APorter GBhagwan RPorter G(2020)Expanding across time to deliver bandwidth efficiency and low latencyProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388244(1-18)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388244
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents