More Web Proxy on the site http://driver.im/

research-article

Free access

Quartz: a new design element for low-latency DCNs

Authors:

Yunpeng James Liu,

Peter Xiang Gao,

Srinivasan KeshavAuthors Info & Claims

SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM

Pages 283 - 294

https://doi.org/10.1145/2619239.2626332

Published: 17 August 2014 Publication History

Abstract

Most datacenter network (DCN) designs focus on maximizing bisection bandwidth rather than minimizing server-to-server latency. We explore architectural approaches to building low-latency DCNs and introduce Quartz, a design element consisting of a full mesh of switches. Quartz can be used to replace portions of either a hierarchical network or a random network. Our analysis shows that replacing high port-count core switches with Quartz can significantly reduce switching delays, and replacing groups of top-of-rack and aggregation switches with Quartz can significantly reduce congestion-related delays from cross-traffic. We overcome the complexity of wiring a complete mesh using low-cost optical multiplexers that enable us to efficiently implement a logical mesh as a physical ring. We evaluate our performance using both simulations and a small working prototype. Our evaluation results confirm our analysis, and demonstrate that it is possible to build low-latency DCNs using inexpensive commodity elements without significant concessions to cost, scalability, or wiring complexity.

References

[1]

Data Center Multi-Tier Model Design. Cisco Data Center Infrastructure 2.5 Design Guide, December 2007. http://bit.ly/11usMXi.

[2]

Acmemicro - Arista 7148SX, December 2013. http://bit.ly/14xquvm.

[3]

Arista 7100 Series. December 2013. http://bit.ly/VBo1Ll.

[4]

Arista 7150 Series. December 2013. http://bit.ly/PUH7uD.

[5]

Cisco Catalyst 4948 Switch. December 2013. http://bit.ly/VtlIbf.

[6]

Quanta T3048-LB8, December 2013. http://bit.ly/173tPpz.

[7]

10Gbps 10GHz DWDM SFP Single Mode 40km Optical Transceivr, May 2014. http://bit.ly/1hAwCXP.

[8]

80 channels, 2RU Rack Mount, Duplex, Athermal AWG, DWDM Mux & Demux, May 2014. http://bit.ly/1iaUSzG.

[9]

Cisco Nexus 7700 Switches. May 2014. http://bit.ly/SZGzs2.

[10]

Fixed Flange E2000/APC Fiber Optic Attenuator 1 to 30dB optional, May 2014. http://bit.ly/1r0skSW.

[11]

Optical Impairment-Aware WSON Control Plane for Cisco ONS 15454 MSTP Data Sheet, May 2014. http://bit.ly/RC8Ljo.

[12]

OpticTrans DWDM 80 Channel Amplifier / EDFA / Fiber Optic Amplifier, June 2014. http://bit.ly/TxiMjg.

[13]

Storm: Distributed and fault-tolerant realtime computation, January 2014. http://storm-project.net/.

[14]

Website for Apache Thrift, January 2014. http://thrift.apache.org/.

[15]

Website for Nuttcp, January 2014. http://bit.ly/1bDluG9.

[16]

H. Abu-Libdeh, P. Costa, A. Rowstron, G. O'Shea, and A. Donnelly. Symbiotic routing in future data centers. In Proceedings of SIGCOMM, New Delhi, India, August 2010.

Digital Library

[17]

M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In Proceedings of SIGCOMM, Seattle, Washington, August 2008.

Digital Library

[18]

M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic flow scheduling for data center networks. In Proceedings of NSDI, San Jose, California, April 2010.

Digital Library

[19]

M. Alizadeh, A. Greenberg, D. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan. Data center TCP (DCTCP). In Proceedings of SIGCOMM, New Delhi, India, August 2010.

Digital Library

[20]

J. E. Berthold. Optical Networking for Data Center Interconnects Across Wide Area Networks. In Proceedings of the Symposium on High-performance Interconnects, New York, New York, August 2009.

Digital Library

[21]

J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. Communications of the ACM Magazine, January 2008.

Digital Library

[22]

M. Dobrescu, N. Egi, K. Argyraki, B.-G. Chun, K. Fall, G. Iannaccone, A. Knies, M. Manesh, and S. Ratnasamy. Routebricks: Exploiting parallelism to scale software routers. In Proceedings of SOSP, Big Sky, Montana, October 2009.

Digital Library

[23]

N. Farrington and A. Andreyev. Facebook's data center network architecture. 2013. http://bit.ly/1mABW01.

[24]

I. Foster. Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering. Boston, MA, Feburary 1995.

Digital Library

[25]

C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: a high performance, server-centric network architecture for modular data centers. In Proceedings of SIGCOMM, Barcelona, Spain, August 2009.

Digital Library

[26]

C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: a scalable and fault-tolerant network structure for data centers. In Proceedings of SIGCOMM, Seattle, Washington, August 2008.

Digital Library

[27]

C. Hong, M. Caesar, and P. Godfrey. Finishing flows quickly with preemptive scheduling. In Proceedings of SIGCOMM, Helsinki, Finland, August 2012.

Digital Library

[28]

N. S. Islam, M. W. Rahman, J. Jose, R. Rajachandrasekar, H. Wang, H. Subramoni, C. Murthy, and D. K. Panda. High performance rdma-based design of hdfs over infiniband. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, Salt Lake City, Utah, November 2012.

Digital Library

[29]

N. Jiang, D. Becker, G. Michelogiannakis, and W. Dally. Network congestion avoidance through speculative reservation. In Proceedings of the HPCA, New Orleans, Louisiana, Feburary 2012.

Digital Library

[30]

S. Kandula, S. Sengupta, A. Greenberg, P. Patel, and R. Chaiken. the nature of data center traffic: Measurements & analysis. In Proceedings of the IMC, Chicago, Illinois, November 2009.

Digital Library

[31]

R. Kapoor, G. Porter, M. Tewari, G. Voelker, and A. Vahdat. Chronos: predictable low latency for data center applications. In Proceedings of the Symposium on Cloud Computing(SoCC), San Jose, CA, October 2012.

Digital Library

[32]

H. Litz, H. Froning, M. Nuessle, and U. Bruning. A HyperTransport Network Interface Controller for Ultra-low Latency Message Transfers. Hyper Transport Consortium, Feburary 2008.

[33]

H. Liu and R. Zhang-Shen. On direct routing in the valiant load-balancing architecture. In Proceedings of the GLOBECOM, St. Louis, Missouri, November 2005.

[34]

S. Miller. Optical fiber telecommunications. Elsevier, 1979.

[35]

J. Mudigonda, P. Yalagandula, M. Al-Fares, and J. C. Mogul. Spain: Cots data-center ethernet for multipathing over arbitrary topologies. In Proceedings of NSDI, San Jose, CA, April 2010.

Digital Library

[36]

S. M. Rumble, D. Ongaro, R. Stutsman, M. Rosenblum, and J. K. Ousterhout. It's time for low latency. In Proceedings of HotOS, Napa, California, May 2011.

Digital Library

[37]

J.-Y. Shin, B. Wong, and E. G. Sirer. Small-world datacenters. In Proceedings of the ACM Symposium on Cloud Computing, Cascais, Portugal, October 2011.

Digital Library

[38]

A. Singla, C. Hong, L. Popa, and P. Godfrey. Jellyfish: Networking data centers randomly. In Proceedings of NSDI, San Jose, California, April 2012.

Digital Library

[39]

R. Teixeira, K. Marzullo, S. Savage, and G. M. Voelker. Characterizing and measuring path diversity of internet topologies. June 2003.

[40]

B. Vamanan, J. Hasan, and T. Vijaykumar. Deadline-aware datacenter tcp (D2TCP). In Proceedings of SIGCOMM, Helsinki, Finland, August 2012.

Digital Library

[41]

C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron. Better never than late: meeting deadlines in datacenter networks. In Proceedings of SIGCOMM, Toronto, Canada, August 2011.

Digital Library

[42]

H. Zang and J. P. Jue. A review of routing and wavelength assignment approaches for wavelength-routed optical WDM networks. Springer's Optical Networks Magazine, January 2000.

[43]

D. Zats, T. Das, P. Mohan, D. Borthakur, and R. Katz. DeTail: Reducing the flow completion time tail in datacenter networks. In Proceedings of SIGCOMM, Helsinki, Finland, August 2012.

Digital Library

Cited By

Li JLei YDe Marchi FJoshi RChandrasekaran BXia Y(2022)Hop-On Hop-Off RoutingProceedings of the 6th Asia-Pacific Workshop on Networking10.1145/3542637.3542647(63-69)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1145/3542637.3542647
Castillo A(2021)A Comprehensive DCell Network Topology Model for a Data Center2021 International Conference on Innovative Computing (ICIC)10.1109/ICIC53490.2021.9692941(1-6)Online publication date: 9-Nov-2021
https://doi.org/10.1109/ICIC53490.2021.9692941
Mellette WDas RGuo YMcGuinness RSnoeren APorter GBhagwan RPorter G(2020)Expanding across time to deliver bandwidth efficiency and low latencyProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388244(1-18)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388244
Show More Cited By

Index Terms

Quartz: a new design element for low-latency DCNs
1. Networks
  1. Network properties
    1. Network structure

Recommendations

Quartz: a new design element for low-latency DCNs
SIGCOMM'14

Most datacenter network (DCN) designs focus on maximizing bisection bandwidth rather than minimizing server-to-server latency. We explore architectural approaches to building low-latency DCNs and introduce Quartz, a design element consisting of a full ...
Juggler: a practical reordering resilient network stack for datacenters
EuroSys '16: Proceedings of the Eleventh European Conference on Computer Systems

We present Juggler, a practical reordering resilient network stack for datacenters that enables any packet to be sent on any path at any level of priority. Juggler adds functionality to the Generic Receive Offload layer at the entry of the network stack ...
Contention resolution considering multicast traffic in optically burst-switched WDM networks

This paper proposes a contention resolution scheme considering multicast traffic in optical burst switching (OBS) networks. In OBS networks, for unicast bursts, contention can be avoided by deflection routing. However, deflection routing cannot be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM

August 2014

662 pages

ISBN:9781450328364

DOI:10.1145/2619239

General Chairs:
Fabián E. Bustamante
Northwestern University, USA
,
Y. Charlie Hu
Purdue University, USA
,
Program Chairs:
Arvind Krishnamurthy
University of Washington, USA
,
Sylvia Ratnasamy
University of California, Berkeley, USA

ACM SIGCOMM Computer Communication Review Volume 44, Issue 4
SIGCOMM'14
October 2014
672 pages
ISSN:0146-4833
DOI:10.1145/2740070
Editors:
Konstantina Papagiannaki
Telefonica Research, Barcelona, Spain
,
Katerina Argyraki
EPFL, Switzerland
,
Hitesh Ballani
Microsoft Research Cambridge, UK
,
Fabián Bustamante
Northwestern University, USA
,
Joseph Camp
SMU, USA
,
Augustin Chaintreau
Columbia University, USA
,
Phillipa Gill
Stony Brook University, USA
,
Marco Mellia
Politecnico di Torino, Italy
,
Bhaskaran Raman
IIT Bombay, India
,
Joel Sommers
Colgate University, USA
,
Aline Carneiro Viana
INRIA, France
Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SIGCOMM'14

Sponsor:

SIGCOMM

SIGCOMM'14: ACM SIGCOMM 2014 Conference

August 17 - 22, 2014

Illinois, Chicago, USA

Acceptance Rates

SIGCOMM '14 Paper Acceptance Rate 45 of 242 submissions, 19%;

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
1,887
Total Downloads

Downloads (Last 12 months)120
Downloads (Last 6 weeks)18

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li JLei YDe Marchi FJoshi RChandrasekaran BXia Y(2022)Hop-On Hop-Off RoutingProceedings of the 6th Asia-Pacific Workshop on Networking10.1145/3542637.3542647(63-69)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1145/3542637.3542647
Castillo A(2021)A Comprehensive DCell Network Topology Model for a Data Center2021 International Conference on Innovative Computing (ICIC)10.1109/ICIC53490.2021.9692941(1-6)Online publication date: 9-Nov-2021
https://doi.org/10.1109/ICIC53490.2021.9692941
Mellette WDas RGuo YMcGuinness RSnoeren APorter GBhagwan RPorter G(2020)Expanding across time to deliver bandwidth efficiency and low latencyProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388244(1-18)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388244
Deng YGuo MRamos AHuang XXu ZLiu W(2020)Optimal low-latency network topologies for cluster performance enhancementThe Journal of Supercomputing10.1007/s11227-020-03216-yOnline publication date: 2-Mar-2020
https://doi.org/10.1007/s11227-020-03216-y
Dahlberg ASkrzypczyk MCoopmans TWubben LRozpędek FPompili MStolk APawełczak PKnegjens Rde Oliveira Filho JHanson RWehner SWu JHall W(2019)A link layer protocol for quantum networksProceedings of the ACM Special Interest Group on Data Communication10.1145/3341302.3342070(159-173)Online publication date: 19-Aug-2019
https://dl.acm.org/doi/10.1145/3341302.3342070
Chen LXia JYi BChen KSeshan SBanerjee S(2018)PowermanProceedings of the 15th USENIX Conference on Networked Systems Design and Implementation10.5555/3307441.3307489(561-578)Online publication date: 9-Apr-2018
https://dl.acm.org/doi/10.5555/3307441.3307489
Li TChen QYu WZhang X(2018)Planar polarization-routing optical cross-connects using nematic liquid crystal waveguidesOptics Express10.1364/OE.26.00040226:1(402)Online publication date: 4-Jan-2018
https://doi.org/10.1364/OE.26.000402
Wu DXia YSun XHuang XDzinamarira SNg TGorinsky STapolcai J(2018)Masking failures from application performance in data center networks with shareable backupProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication10.1145/3230543.3230577(176-190)Online publication date: 7-Aug-2018
https://dl.acm.org/doi/10.1145/3230543.3230577
Wang MCui YXiao SWang XYang DChen KZhu J(2018)Neural Network Meets DCNProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/32244212:2(1-25)Online publication date: 13-Jun-2018
https://dl.acm.org/doi/10.1145/3224421
Chen LChen KZhu ZYu MPorter GQiao CZhong SAkella AHowell J(2017)Enabling wide-spread communications on optical fabric with megaswitchProceedings of the 14th USENIX Conference on Networked Systems Design and Implementation10.5555/3154630.3154678(577-593)Online publication date: 27-Mar-2017
https://dl.acm.org/doi/10.5555/3154630.3154678
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents