[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1477942.1477972acmconferencesArticle/Chapter ViewAbstractPublication PagesancsConference Proceedingsconference-collections
research-article

Design optimization of a highly parallel InfiniBand host channel adapter

Published: 06 November 2008 Publication History

Abstract

Network processors use highly parallel architectures to improve performance and reach multi-gigabit line-speeds. In this paper, we emulate a pipeline in a highly parallel non-programmable industrial InfiniBand Host Channel Adapter to make a performance and bottleneck analysis and, at the same time, explore the potential of a pipelined architecture. Therefore, starting from the original Host Channel Adapter model with multiple send- and receive-side packet-processing units, we compare its performance capabilities with that of a pipelined design by introducing a central arbiter synchronizing the state machines of the different packet-processing instances to achieve a pipelined behavior. We show that the pipelined model achieves a performance comparable to that of the parallel design in most of our micro-benchmarks, making it a valid option for next-generation high-speed adapters. At the same time, our approach enables a deeper analysis of the original architecture and a better understanding of the actual processing requirements, and therefore offers valuable insights for future designs.

References

[1]
J. Beecroft, D. Addison, F. Petrini, M. McLaren. QsNetII: An Interonnect for Supercomputing Applications. Hot Chips 2003.
[2]
InfiniBand Trade Association. InfiniBand Architecture Specification, Release 1.1. November 2002.
[3]
A. Vishnu, B. Benton, D. K. Panda. High Performance MPI on IBM 12x InfiniBand Architecture. Parallel and Distributed Computing Symposium 2007.
[4]
C. Raisch. eHCA Virtualization on System p. OpenFabrics Sonoma Workshop 2008.
[5]
Compaq, Intel and Microsoft Corporation. Virtual Interface Architecture Specification, Version 1.0. December 1997.
[6]
O. Lachish and A. Ziv. "Object-oriented high-level modeling of an InfiniBand to PCI-X bridge". System Specification & Design Languages: Best of FDL'02. Springer 2003.
[7]
J. Teich. Design space exploration of actor based specifications on FPGA. Workshop on Distributed Embedded Systems 2005.
[8]
J. Liu, A. Mamidala, A. Vishnu, D. K. Panda. Performance Evaluation of InfiniBand with PCI Express. IEEE Micro 2005.
[9]
S. Sur, A. Vishnu, H.-W. Jin, W. Huang, D. K. Panda. Can Memory-Less Network Adapters Benefit Next-Generation InfiniBand Systems?. HOTI 2005.
[10]
S. Sur, M. J. Koop, L. Chai, D. K. Panda. Performance Analysis and Evaluation of Mellanox ConnectX InfiniBand Architecture with Multi-Core Platforms. HOTI 2007.
[11]
J. Liu, B. Chandrasekaran, J. Wu, W. Jiang, S. Kini, W. Yu, D. Bantinas, P. Wyckoff, D. K. Panda. Performance Comparison of MPI Implementations over InfiniBand, Myrinet, Quadrics. Supercomputing Conference 2003.
[12]
H. Hellwagner, A. Reinefeld. SCI: Scalable Coherent Interface, Architecture and Software for High Performance Computer Clusters. Springer 1999.
[13]
B. Sinharoy, R. N. Kalla, J. M. Tendler, R. J. Eickemeyer, J. B. Joyner. POWER5: System Microarchitecture. IBM J. Res. & Dev., Vol. 49, No. 4. July 2004.
[14]
B. Holden. Latency Comparison Between HyperTransport and PCI-Express in Communication Systems. White paper. November 2006.
[15]
D. D. Clark, V. Jacobson, J. Romkey, H. Salwen. An Analysis of TCP Processing Overhead. IEEE Communications Magazine, Vol. 27, No. 6. June 1989.

Cited By

View all
  • (2015)LW-RDMAProceedings of the 2015 Conference on research in adaptive and convergent systems10.1145/2811411.2811471(395-399)Online publication date: 9-Oct-2015

Index Terms

  1. Design optimization of a highly parallel InfiniBand host channel adapter

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ANCS '08: Proceedings of the 4th ACM/IEEE Symposium on Architectures for Networking and Communications Systems
      November 2008
      191 pages
      ISBN:9781605583464
      DOI:10.1145/1477942
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 06 November 2008

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. ASIC
      2. HCA
      3. InfiniBand
      4. design
      5. host channel adapter
      6. optimization
      7. pipeline

      Qualifiers

      • Research-article

      Conference

      ANCS '08

      Acceptance Rates

      ANCS '08 Paper Acceptance Rate 17 of 67 submissions, 25%;
      Overall Acceptance Rate 88 of 314 submissions, 28%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 14 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2015)LW-RDMAProceedings of the 2015 Conference on research in adaptive and convergent systems10.1145/2811411.2811471(395-399)Online publication date: 9-Oct-2015

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media