[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

High-throughput multi-multicast transfers in data center networks

Published: 01 January 2017 Publication History

Abstract

It is usual that the applications executed in data centers require the distribution of the same data from one node to others at various execution points and that some of them require to cope with multiple of these diffusions in parallel. Multicast-based communications are an alternative solution to sending data efficiently to multiple nodes. This paper proposes a novel technique which offers reliability and congestion control in the multi-multicast transfers in data center networks. The proposal is based on: (1) a new congestion control mechanism, which monitors the control information of the receivers, reducing the server injection rate, (2) taking advantage of the switch diffusion hardware, and (3) using IGMP snooping, which allows a network switch to multicast a packet just to the output links with host receivers joined to a multicast group. The implementation is made at user level and uses the UDP interface. Evaluation tests are performed in a CentOS-based cluster composed of 12 servers in the presence of multiple diffusions at the same time. Test results show improvements in the global bandwidth, avoid network saturation, and reduce overhead included by unicast communications in data transmission.

References

[1]
DRBD: Distributed replicated block device
[2]
Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST '10, pp 1---10. IEEE Computer Society, Washington, DC, USA
[3]
Postel JB (1981) Transmission control protocol. Internet request for comments, September. RFC 793
[4]
Lane RG, Daniels S, Yuan X (2007) An empirical study of reliable multicast protocols over ethernet-connected networks. Perform Eval 64(3):210---228
[5]
Solensky F, Christensen M, Kimball K (2006) Rfc 4541: considerations for internet group management protocol (IGMP) and multicast listener discovery (MLD) snooping switches
[6]
McBride M, Lui H (2012) Multicast in the data center overview. IETF, Internet Draft
[7]
Atwood JW (2004) A classification of reliable multicast protocols. IEEE Netw 18(3):24---34
[8]
Obraczka K (1998) Multicast transport protocols: a survey and taxonomy. Commun Mag IEEE 36(1):94---102
[9]
Chowdhury S, Fatema K (2013) Analysing TCP performance when link experiencing packet loss. Master's thesis, University of Gothenburg, Göteborg, Sweden (2013)
[10]
Yamamoto K, Sawa Y, Yamamoto M, Ikeda H (2000) Performance evaluation of ack-based and nak-based flow control schemes for reliable multicast. In: TENCON 2000. Proceedings, vol 1, pp 341---345
[11]
Li D, Xu M, Liu Y, Xie X, Cui Y, Wang J, Chen G (2014) Reliable multicast in data center networks. Comput, IEEE Trans 63(8):2011---2024.
[12]
Miliotis V, Alonso L, Verikoukis C (2014) CooPNC: a cooperative multicast protocol exploiting physical layer network coding. Ad Hoc Netw 14:35---50.
[13]
Adamson B, Macker J, Bormann C, Handley M (2009) Rfc 5740: Nack-oriented reliable multicast (NORM) transport protocol. In: Technical report
[14]
Kasera SK, Hjalmtusson G, Towsley DF, Kurose JF (2000) Scalable reliable multicast using multiple multicast channels. IEEE/ACM Trans Netw 8(3):294---310
[15]
Gemmell J, Montgomery T, Speakman T, Crowcroft J (2003) The PGM reliable multicast protocol. Netw IEEE 17(1):16---22
[16]
Li J, Veeraraghavan M. May
[17]
Paul S, Sabnani KK, Lin JC-H, Bhattacharyya S (1997) Reliable multicast transport protocol (RMTP). IEEE J Sel Areas Commun 15(3):407---421
[18]
Yavatkar R, Griffoen J, Sudan M (1995) A reliable dissemination protocol for interactive collaborative applications. In: Proceedings of the third ACM international conference on multimedia, MULTIMEDIA '95, pp 333---344. ACM, New York, NY, USA
[19]
Holbrook HW, Singhal SK, Cheriton DR (1995) Log-based receiver-reliable multicast for distributed interactive simulation. SIGCOMM Comput Commun Rev 25(4):328---341
[20]
Sheu T-L, Lin S-T (2013) A multicast retransmission scheme using negative ack in wireless networks. In: 2013 IEEE 27th international conference on advanced information networking and applications (AINA), pp 1144---1149
[21]
Palacios RH, Díaz AF, Ortega J, Rodríguez-Quintana C, Anguita M (2015) Analyzing high-throughput multicast traffic in cluster computing. In: Proceedings of the 15th international conference on computational and mathematical methods in science and engineering, CMMSE 2015 6---10

Cited By

View all
  • (2021)A Global Data Model for Electric Power Data CentersJournal of Signal Processing Systems10.1007/s11265-019-01474-593:2-3(201-208)Online publication date: 1-Mar-2021
  • (2017)Evaluation of redundant data storage in clusters based on multi-multicast and local storageThe Journal of Supercomputing10.1007/s11227-016-1913-673:1(576-590)Online publication date: 1-Jan-2017
  1. High-throughput multi-multicast transfers in data center networks

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image The Journal of Supercomputing
      The Journal of Supercomputing  Volume 73, Issue 1
      January 2017
      606 pages

      Publisher

      Kluwer Academic Publishers

      United States

      Publication History

      Published: 01 January 2017

      Author Tags

      1. Congestion control
      2. Data center networks
      3. High throughput
      4. Multi-multicast
      5. Multicast
      6. Reliable multicast protocol
      7. UDP

      Qualifiers

      • Article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 14 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)A Global Data Model for Electric Power Data CentersJournal of Signal Processing Systems10.1007/s11265-019-01474-593:2-3(201-208)Online publication date: 1-Mar-2021
      • (2017)Evaluation of redundant data storage in clusters based on multi-multicast and local storageThe Journal of Supercomputing10.1007/s11227-016-1913-673:1(576-590)Online publication date: 1-Jan-2017

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media