Abstract
Data centers are now the basis for many Internet and cloud computing services. Trends toward multi-core processors, end-host virtualization, and commodities of scale are pointing to future single-site data centers with millions of virtual end-hosts. The Ethernet/IP style layer 2 and layer 3 network protocols are facing some mixture of inherent limitations in supporting such large topologies: lack of scalability, difficult to management, inflexible in communication, limited support for virtual machine migration. Although several large layer 2 network technologies have been proposed in recent years, they still have several weaknesses that impede them from practical applications such as inflexible, broadcast storms, un-scalability and un-interoperability with existing devices. Software defined networking (SDN) is an emerging promising solution to the above problems due to its outstanding characteristics of control plane and data plane separation, centralized and flexible network management. However, the limited efficiency of the centralized SDN Controller and the large number of routing rules needed in switches are the two faced main challenges in scalability when adopting the existing SDN solutions in large data centers. Therefore, this paper proposes a novel SDN based large layer 2 network fabric for data centers: SFabric, which deals with the two challenges by highly reducing the interactions between the Controller and switches in computing and constructing the paths among switches in advance, and decreasing the number of routing rules in tagging and routing packets at switch levels. A prototype is developed and experimental results prove the good efficiency and scalability of the proposed method.
Similar content being viewed by others
Notes
If there is no ambiguity, we will use flow entry for OpenFlow flow entry in the rest of this paper for simplicity.
References
Inside Microsoft’s $550 Million Mega Data Centers www.informationweek.com/news/hardware/datacenters/showArticle.jhtml?articleID=208403723
Cisco Global Cloud Index: Forecast and Methodology, 2013–2018. http://www.cisco.com/c/en/us/solutions/collateral/service-provider/global-cloud-indexgci/CloudIndexWhitePaper.html
Mysore, R.N. et al.: Portland: a scalable fault-tolerant layer 2 data center network fabric. In: Proceedings of the ACM SIGCOMM 2009 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. pp. 39–50 (2009)
Kim, C., Caesar, M., Rexford, J.: Floodless in Seattle: a scalable ethernet architecture for large enterprises. In: Proceedings of the ACM SIGCOMM 2008 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. pp. 3–14 (2008)
Scott, M., Moore, A., Crowcroft, J.: Addressing the scalability of ethernet with moose. In: Proceedings of the First Workshop on Data CenterCConverged and Virtual Ethernet Switching (DC CAVES), ITC 21. Paris (2009)
Wang, H.: TRILL-based Large Layer 2 Network Solution. White Paper (2012)
Xu, Z., Luo, X., Wang, L.: Incremental building association link network. Comput. Syst. Sci. Eng. 26(3), 153–162 (2011)
VCS. http://www.brocade.com/solutionstechnology/technology/vcs-technology/index.page
Lu, C., Jiang, Z., Yu, J., Zhang, G., Li, M., Liang, W., Bi, J.: Understanding the overhead of large layer 2 data center networking: Measurement and analysis of TRILL as an example. In: Proceedings of the third International Conference on Innovative Computing Technology, City Temple Conference Centre, pp. 29–31, London, UK, (2013)
McKeown, N., et al.: OpenFlow: enabling innovation in campus networks. Comput. Commun. Rev. 38(2), 69–74 (2008)
Ramos, R.M., Martinello, M., Rothenberg, C.E: Slickflow: resilient source routing in data center networks unlocked by openflow. In: Proceedings of the 38th Annual IEEE Conference on Local Computer Networks, pp. 606–613, Sydney, Australia, 21–24 October 2013. http://doi.ieeecomputersociety.org/10.1109/LCN.2013.6761297
Lu, X., Xu, Y.: SFabric: a scalable SDN based large layer 2 data center network fabric. In: Proceedings of IWQoS (2015)
Cisco Data Center Infrastructure 2.5 Design Guide. www.cisco.com/application/pdf/en/us/guest/netsol/ns107/c649/ccmigration 09186a008073377d.pdf
Sherwood, R., Chan, M., Covington, G.A., Gibb, G., Flajslik, M., Handigol, N., Huang, T., Kazemian, P., Kobayashi, M., Naous, J., Seetharaman, S., Underhill, D., Yabe, T., Yap, K., Yiakoumis, Y., Zeng, H., Appenzeller, G., Johari, R., McKeown, N., Parulkar, G.M.: Carving research slices out of your production networks with OpenFlow. Comput. Commun. Rev. 40(1), 129–130 (2010). https://doi.org/10.1145/1672308.1672333
Dely, P., Kassler, A., Bayer, N.: Openflow for wireless mesh networks. In: Proceedings of 20th International Conference on Computer Communications and Networks, ICCCN 2011, pp. 1–6 Maui, Hawaii, July 31–August 4 2011. http://dx.doi.org/10.1109/ICCCN.2011.6006100
OpenVSwitch. http://openvswitch.org
Pica8 Open Network Fabric. http://www.pica8.org/solutions/openflow.php
Indigo Open Source OpenFlow Switches. http://www.openflowhub.org/display/Indigo/
Heller, B: OpenFlow Switch Specification, Version 1.5.0. https://www.opennetworking.org/images/stories/downloads/sdn-resources/onfspecifications/openflow/openflow-switch-v1.5.0.noipr.pdf
Al-Fares, M., Loukissas, A., Vahdat, A: A scalable, commodity data center network architecture. In: Proceedings of the ACM SIGCOMM 2008 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, pp. 63–74, Seattle, WA, USA, 17–22 August 2008. http://doi.acm.org/10.1145/1402958.1402967
Greenberg, A.G., Lahiri, P., Maltz, D.A., Patel, P., Sengupta, S: Towards a next generation data center architecture: scalability and commoditization. In: Proceedings of the ACM SIGCOMM 2008 Workshop on Programmable Routers for Extensible Services of Tomorrow, PRESTO 2008, pp. 57–62, Seattle, WA, USA, 22 August 2008. http://doi.acm.org/10.1145/1397718.1397732
Rodeheffer, T.L., Thekkath, C.A., Anderson, D.C.: Smartbridge: a scalable bridge architecture. In: Proceedings of the SIGCOMM, pp. 205–216 (2000). http://doi.acm.org/10.1145/347059.347546
Guo, C., Wu, H., Tan, K., Shi, L., Zhang, Y., Lu,, S.: Dcell: a scalable and fault-tolerant network structure for data centers. In: Proceedings of the ACM SIGCOMM 2008 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, pp. 75–86, Seattle, WA, USA, 17–22 August 2008. http://doi.acm.org/10.1145/1402958.1402968
L. S. C. of the IEEE Computer Society. IEEE Standard for Local and Metropolitan Area Networks, Common Speci cations Part 3: Media Access Control (MAC), Bridges Ammendment 2: Rapid Recon guration (2001)
Mudigonda, J., Yalagandula, P., Al-Fares, M., Mogul J.C.: SPAIN: COTS data-center ethernet for multipathing over arbitrary topologies. In: Proceedings of the 7th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2010, pp. 265–280, San Jose, CA, USA, 28–30 April 2010
Schlansker, M., Turner, Y., Tourrilhes, J., Karp, A.: Enabling routing for datacenter networks. In: Proceedings of the Architecture for Networking and Communications Systems, ANCS, pp. 1–12 (2010)
Perlman, R.J.: Rbridges: transparent routing. In: Proceedings IEEE INFOCOM 2004, The 23rd Annual Joint Conference of the IEEE Computer and Communications Societies, Hong Kong, China, 7–11 March 2004
Amamou, A., Haddadou, K., Pujolle, G.: A trill-based multi-tenant data center network. Comput. Netw. 68, 35–53 (2014)
OpenDayLight. http://OpenDayLight.org
Huang, D.Y., Yocum, K., Snoeren, A.C.: High-fidelity switch models for software-defined network emulation. In: Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, HotSDN 2013, The Chinese University of Hong Kong, pp. 43–48, Hong Kong, China, 16 August 2013. http://doi.acm.org/10.1145/2491185.2491188
Martinello, M., Ribeiro, M.R.N., de Oliveira, R.E.Z., de Angelis Vitoi, R.: Keyflow: a prototype for evolving SDN toward core network fabrics”. IEEE Netw. 28(2), 12–19 (2014). https://doi.org/10.1109/MNET.2014.6786608
Casado, M., Koponen, T., Shenker, S., Tootoonchian, A.: Fabric: a retrospective on evolving SDN. In: Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, HotSDN 2012, pp. 1–5 (2012)
Raghavan, B., Casado, M., Koponen, T., Ratnasamy, S., Ghodsi, A., Shenker, S.: Software-defined internet architecture: decoupling architecture from infrastructure. In: Proceedings of the 11th ACM Workshop on Hot Topics in Networks, HotNets-XI, Redmond, pp. 43–48, WA, USA, 29–30 October 2012. https://doi.org/10.1145/2390231.2390239
Shu, Z., Wan, J., Lin, J., Wang, S., Li, D., Rho, S., Yang, C.: Traffic engineering in software-defined networking: measurement and management. IEEE Access 4, 3246–3256 (2016). https://doi.org/10.1109/ACCESS.2016.2582748
Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., Zolla, J., H¨olzle, U., Stuart, S., Vahdat, A.: B4: experience with a globally-deployed software defined wan. In: Proceedings of the ACM SIGCOMM 2013 Conference, SIGCOMM’13, pp. 3–14, Hong Kong, China, 12–16 August 2013. https://doi.org/10.1145/2486001.2486019
Mininet. http://mininet.org
Acknowledgements
This research was supported by the Natural Science Foundation of Shanghai under Grant No. 14ZR1427700 and the National High Technology Research and Development Program (863 Plan) Project “Software Defined Networking (SDN) Scale Testing and Validation for Multi-Service Convergence” under Grant No. 2015AA016106, and Shanghai Youth Science and Technology Star Project “Key Technology Research and Application of SDN Controller for Cloud Computing” under Grant No. 15QB1404100.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lu, X., Xu, Y. SFabric: a scalable SDN based large layer 2 data center network fabric. Cluster Comput 22 (Suppl 3), 6657–6668 (2019). https://doi.org/10.1007/s10586-018-2399-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-018-2399-1