More Web Proxy on the site http://driver.im/

research-article

Millions of little minions: using packets for low latency network programming and visibility

Authors:

Vimalkumar Jeyakumar,

Mohammad Alizadeh,

David MazièresAuthors Info & Claims

ACM SIGCOMM Computer Communication Review, Volume 44, Issue 4

Pages 3 - 14

https://doi.org/10.1145/2740070.2626292

Published: 17 August 2014 Publication History

Abstract

This paper presents a practical approach to rapidly introducing new dataplane functionality into networks: End-hosts embed tiny programs into packets to actively query and manipulate a network's internal state. We show how this "tiny packet program" (TPP) interface gives end-hosts unprecedented visibility into network behavior, enabling them to work with the network to achieve a desired functionality. Our design leverages what each component does best: (a) switches forward and execute tiny packet programs (at most 5~instructions) in-band at line rate, and (b) end-hosts perform arbitrary (and easily updated) computation on network state. By implementing three different research proposals, we show that TPPs are useful. Using a hardware prototype on a NetFPGA, we show our design is feasible at a reasonable cost.

References

[1]

Mohammad Alizadeh, Tom Essall, Sarang Dharmapurikar, Ramanan Vaidyanathan, Kevin Chu, Andy Fingerhut, Terry Lam, Francis Matus, Rong Pan, Navindra Yadav, and George Varghese. "CONGA: Distributed Congestion-Aware Load Balancing for Datacenters". In: SIGCOMM (2014).

Digital Library

[2]

Mohammad Alizadeh, Shuang Yang, Milad Sharif, Sachin Katti, Nick McKeown, Balaji Prabhakar, and Scott Shenker. "pFabric: Minimal Near-Optimal Datacenter Transport". In: SIGCOMM (2013).

Digital Library

[3]

Arista Networks -- 7100 Series Performance Results. http://www.aristanetworks.com/media/system/pdf/7148sx-rfc2889-broadcast-with-latency.pdf, Retrieved January 23, 2014.

[4]

Eric A Baden, Mohan Kalkunte, John J Dull, and Venkateshwar Buduma. Field processor for a network device. US Patent 7,787,471. 2010.

[5]

A.D. Berenbaum, Alexander Gibson Fraser, and Hubert Rae McLellan Jr. In-band device configuration protocol for ATM transmission convergence devices. US Patent 08/939,746. 2001.

[6]

Pat Bosshart and Glen Gibb. Personal communication, 2014-01-27.

[7]

Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. "Forwarding Metamorphosis: Fast Programmable Match-Action Processing in Hardware for SDN". In: SIGCOMM (2013).

Digital Library

[8]

Sarang Dharmapurikar. Insieme Networks, Personal communication, 2013-07-18.

[9]

Nandita Dukkipati and Nick McKeown. "Why Flow-Completion Time is the Right metric for Congestion Control". In: SIGCOMM CCR (2006).

Digital Library

[10]

ELAM Overview. http://www.cisco.com/c/en/us/support/docs/switches/nexus-7000-series-switches/116648-technote-product-00.html, Retrieved March 13, 2014.

[11]

Dongsu Han, Robert Grandl, Aditya Akella, and Srinivasan Seshan. "FCP: a flexible transport framework for accommodating diversity". In: SIGCOMM (2013).

Digital Library

[12]

Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, Bob Lantz, and Nick McKeown. "Reproducible network experiments using container-based emulation". In: CoNEXT (2012).

Digital Library

[13]

Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, David Mazières, and Nick McKeown. "I Know What Your Packet Did Last Hop: Using Packet Histories to Troubleshoot Networks". In: NSDI (2014).

Digital Library

[14]

Danny Yuxing Huang, Kenneth Yocum, and Alex C Snoeren. "High-Fidelity Switch Models for Software-Defined Network Emulation". In: HotSDN (2013).

[15]

IEEE 802.1Qbb -- Priority-based Flow Control. http://www.ieee802.org/1/pages/802.1bb.html, Retrieved April 1 2014.

[16]

Intel Fulcrum FM4000 ASIC. http://www.intel.com/content/dam/www/public/us/en/documents/datasheets/ethernet-switch-fm4000-datasheet.pdf, Retrieved July 1, 2013.

[17]

Intel Fulcrum FM6000 ASIC. http://www.ethernetsummit.com/English/Collaterals/Proceedings/2013/20130404_S23_Ozdag.pdf, Retrieved July 1, 2013.

[18]

Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, et al. "B4: Experience with a globally-deployed software defined WAN". In: SIGCOMM (2013).

Digital Library

[19]

Vimalkumar Jeyakumar, Mohammad Alizadeh, Changhoon Kim, and David Mazières. "Tiny Packet Programs for low-latency network control and monitoring". In: HotNets (2013).

Digital Library

[20]

Dina Katabi, Mark Handley, and Charlie Rohrs. "Congestion control for high bandwidth-delay product networks". In: SIGCOMM (2002).

Digital Library

[21]

Peyman Kazemian, Michael Chang, Hongyi Zeng, George Varghese, Nick McKeown, and Scott Whyte. "Real Time Network Policy Checking using Header Space Analysis". In: NSDI (2013).

Digital Library

[22]

Frank Kelly, Gaurav Raina, and Thomas Voice. "Stability and fairness of explicit congestion control with small buffers". In: SIGCOMM CCR (2008).

Digital Library

[23]

Ahmed Khurshid, Xuan Zou, Wenxuan Zhou, Matthew Caesar, and P Brighten Godfrey. "VeriFlow: Verifying Network-Wide Invariants in Real Time". In: NSDI (2013).

Digital Library

[24]

Changhoon Kim. Windows Azure, Personal communication, 2014-01-26.

[25]

Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M Frans Kaashoek. "The Click modular router". In: TOCS (2000).

Digital Library

[26]

Guohan Lu, Chuanxiong Guo, Yulong Li, Zhiqiang Zhou, Tong Yuan, Haitao Wu, Yongqiang Xiong, Rui Gao, and Yongguang Zhang. "ServerSwitch: a programmable and high performance platform for data center networks". In: NSDI (2011).

Digital Library

[27]

Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. "OpenFlow: Enabling Innovation in Campus Networks". In: SIGCOMM CCR (2008).

Digital Library

[28]

Millions of Little Minions: Using Packets for Low Latency Network Programming and Visibility (extended version). http://arxiv.org/abs/1405.7143. 2014.

[29]

OpenFlow Switch Specification, version 1.4. https://www.opennetworking.org/images/stories/downloads/sdn-resources/onf-specifications/openflow/openflow-spec-v1.4.0.pdf, Retrieved April 1, 2014.

[30]

Rong Pan, Balaji Prabhakar, and Ashvin Laxmikantha. "QCN: Quantized congestion notification". In: IEEE802 1 (2007).

[31]

Ben Pfaff, Justin Pettit, Keith Amidon, Martin Casado, Teemu Koponen, and Scott Shenker. "Extending Networking into the Virtualization Layer." In: HotNets (2009).

[32]

Mark Reitblatt, Nate Foster, Jennifer Rexford, Cole Schlesinger, and David Walker. "Abstractions for Network Update". In: SIGCOMM (2012).

Digital Library

[33]

Beverly Schwartz, Alden W Jackson, W Timothy Strayer, Wenyi Zhou, R Dennis Rockwell, and Craig Partridge. "Smart packets for active networks". In: Open Architectures and Network Programming Proceedings (1999).

[34]

Anirudh Sivaraman, Keith Winstein, Suvinay Subramanian, and Hari Balakrishnan. "No silver bullet: extending SDN to the data plane". In: HotNets (2013).

Digital Library

[35]

Ao Tang, Jiantao Wang, Steven H Low, and Mung Chiang. "Equilibrium of heterogeneous congestion control: Existence and uniqueness". In: IEEE TON (2007).

Digital Library

[36]

David L Tennenhouse and David J Wetherall. "Towards an Active Network Architecture". In: DARPA Active Nets. Conf. and Exposition (2002).

Digital Library

[37]

Tilman Wolf and Jonathan S Turner. "Design Issues for High Performance Active Routers". In: IEEE Journal on Sel. Areas in Comm. (2001).

Digital Library

[38]

David Zats, Anand Padmanabha Iyer, Randy H Katz, Ion Stoica, and Amin Vahdat. "FastLane: An Agile Congestion Signaling Mechanism for Improving Datacenter Performance". In: Technical Report UCB/EECS-2013-113 (2013).

Cited By

Schulz LHausheer D(2024)ID-INT: Secure Inter-Domain In-Band Telemetry2024 20th International Conference on Network and Service Management (CNSM)10.23919/CNSM62983.2024.10814310(1-9)Online publication date: 28-Oct-2024
https://doi.org/10.23919/CNSM62983.2024.10814310
Ding RLiu XYang SHuang QXie BSun RZhang ZCui BSekar VYu MSeneviratne AVeitch D(2024)RD-Probe: Scalable Monitoring With Sufficient Coverage In Complex Datacenter NetworksProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672256(258-273)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672256
Sadi ASavi MMelis APrandini MCallegati F(2024)Unleashing Dynamic Pipeline Reconfiguration of P4 Switches for Efficient Network MonitoringIEEE Transactions on Network and Service Management10.1109/TNSM.2024.337753821:3(3482-3497)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1109/TNSM.2024.3377538
Show More Cited By

Index Terms

Millions of little minions: using packets for low latency network programming and visibility
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Networks
  1. Network architectures

Recommendations

Millions of little minions: using packets for low latency network programming and visibility
SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM

This paper presents a practical approach to rapidly introducing new dataplane functionality into networks: End-hosts embed tiny programs into packets to actively query and manipulate a network's internal state. We show how this "tiny packet program" (...
WireCAP: a novel packet capture engine for commodity NICs in high-speed networks
IMC '14: Proceedings of the 2014 Conference on Internet Measurement Conference

Packet capture is an essential function for many network applications. However, packet drop is a major problem with packet capture in high-speed networks. This paper presents WireCAP, a novel packet capture engine for commodity network interface cards (...
Sprinklers: A Randomized Variable-Size Striping Approach to Reordering-Free Load-Balanced Switching
CoNEXT '14: Proceedings of the 10th ACM International on Conference on emerging Networking Experiments and Technologies

Internet traffic continues to grow exponentially, calling for switches that can scale well in both size and speed. While load-balanced switches can achieve such scalability, they suffer from a fundamental packet reordering problem. Existing proposals ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGCOMM Computer Communication Review

ACM SIGCOMM Computer Communication Review Volume 44, Issue 4

SIGCOMM'14

October 2014

672 pages

ISSN:0146-4833

DOI:10.1145/2740070

Editors:
Konstantina Papagiannaki
Telefonica Research, Barcelona, Spain
,
Katerina Argyraki
EPFL, Switzerland
,
Hitesh Ballani
Microsoft Research Cambridge, UK
,
Fabián Bustamante
Northwestern University, USA
,
Joseph Camp
SMU, USA
,
Augustin Chaintreau
Columbia University, USA
,
Phillipa Gill
Stony Brook University, USA
,
Marco Mellia
Politecnico di Torino, Italy
,
Bhaskaran Raman
IIT Bombay, India
,
Joel Sommers
Colgate University, USA
,
Aline Carneiro Viana
INRIA, France

Issue’s Table of Contents

SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM
August 2014
662 pages
ISBN:9781450328364
DOI:10.1145/2619239
General Chairs:
Fabián E. Bustamante
Northwestern University, USA
,
Y. Charlie Hu
Purdue University, USA
,
Program Chairs:
Arvind Krishnamurthy
University of Washington, USA
,
Sylvia Ratnasamy
University of California, Berkeley, USA

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2014

Published in SIGCOMM-CCR Volume 44, Issue 4

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Computer and Network Systems

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

140
Total Citations
View Citations
4,217
Total Downloads

Downloads (Last 12 months)216
Downloads (Last 6 weeks)27

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schulz LHausheer D(2024)ID-INT: Secure Inter-Domain In-Band Telemetry2024 20th International Conference on Network and Service Management (CNSM)10.23919/CNSM62983.2024.10814310(1-9)Online publication date: 28-Oct-2024
https://doi.org/10.23919/CNSM62983.2024.10814310
Ding RLiu XYang SHuang QXie BSun RZhang ZCui BSekar VYu MSeneviratne AVeitch D(2024)RD-Probe: Scalable Monitoring With Sufficient Coverage In Complex Datacenter NetworksProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672256(258-273)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672256
Sadi ASavi MMelis APrandini MCallegati F(2024)Unleashing Dynamic Pipeline Reconfiguration of P4 Switches for Efficient Network MonitoringIEEE Transactions on Network and Service Management10.1109/TNSM.2024.337753821:3(3482-3497)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1109/TNSM.2024.3377538
Chen XLiu HXiao QHuang QZhang DZhou HZhou BWu CLiu XYang Q(2024)Hermes: Low-Overhead Inter-Switch Coordination in Network-Wide Data Plane Program DeploymentIEEE/ACM Transactions on Networking10.1109/TNET.2024.336132432:4(2842-2857)Online publication date: Aug-2024
https://doi.org/10.1109/TNET.2024.3361324
Puttlitz CParizotto RSchaeffer-Filho A(2024)P4NetIntel: End-to-End Network Telemetry with eBPF and XDP2024 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN)10.1109/NFV-SDN61811.2024.10807468(1-6)Online publication date: 5-Nov-2024
https://doi.org/10.1109/NFV-SDN61811.2024.10807468
Tao WLinguaglossa L(2024)A First Look at the Impact of Measurement on Orchestrating Digital Twin Network2024 IEEE 13th International Conference on Cloud Networking (CloudNet)10.1109/CloudNet62863.2024.10815817(1-6)Online publication date: 27-Nov-2024
https://doi.org/10.1109/CloudNet62863.2024.10815817
N’Diaye TLuizelli MDegila JBuriol L(2024)Improved Routing for the In-Band Network Telemetry ProblemMathematical Modeling in Physical Sciences10.1007/978-3-031-52965-8_46(619-636)Online publication date: 24-May-2024
https://doi.org/10.1007/978-3-031-52965-8_46
Yang KWu YMiao RYang TLiu ZXu ZQiu RZhao YLv HJi ZXie GSchulzrinne HKohler EMaltz DMisra V(2023)ChameleMon: Shifting Measurement Attention as Network State ChangesProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604850(881-903)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604850
Liatifis ASarigiannidis PArgyriou VLagkas T(2023)Advancing SDN from OpenFlow to P4: A SurveyACM Computing Surveys10.1145/355697355:9(1-37)Online publication date: 16-Jan-2023
https://dl.acm.org/doi/10.1145/3556973
Sankaran GSivalingam KGondaliya H(2023)P4 and NetFPGA-Based Secure In-Network Computing Architecture for AI-Enabled Industrial Internet of ThingsIEEE Internet of Things Journal10.1109/JIOT.2021.312586210:4(2979-2994)Online publication date: 15-Feb-2023
https://doi.org/10.1109/JIOT.2021.3125862
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents