Abstract
In order to meet the requirements of performance heterogeneous computing systems, intelligent systems, and data centers for low-latency, high-throughput, and low-overhead data resource sharing capabilities, a PCIe-based multi-node efficient interconnection mechanism was proposed. We propose a PCIe-based interconnection framework, and adopt the native PCIe switching channel and cross-node efficient interconnection mechanism to design and implement the functions of memory sharing, reflective memory, RDMA and other functions between distributed heterogeneous node device resources. The proposed interconnection mechanism is able to ensure the efficient flow of batch data between different task nodes, and maximize the efficiency of equipment resource collaboration within the potential area. In the final performance analysis, the proposed PCIe-based multi-node efficient interconnection mechanism is tested, and the RDMA data transmission rate can reach 48.65 Gb/s with x8 lanes, which is better than the transmission bandwidth of Ethernet.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jin, H., Yang, H.Z.: Summary of research on RDMA network transmission technology. Technol. Wind 2020(18), 137 (2020)
Cao, W., Zhang, Y., Yang, X., et al.: PolarDB serverless: a cloud native database for disaggregated data centers. In: International Conference on Management of Data, Virtual Event, China, pp. 2477–2479 (2021)
Jin, H., Mei, J.J.: Research on a method of RDMA transmission control. Netw. Secur. Technol. Appl. 2020(5), 19–20 (2020)
Xu, J., Chen, Y., et al.: LightPool: a NVMe-oF-based high-performance and lightweight storage pool architecture for cloud-native distributed database. In: 2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA), Edinburgh, United Kingdom, pp. 983–995 (2024)
Hou, W., Zhang, J., et al.: Understanding routable PCIe performance for composable infrastructures. In: Symposium on Networked Systems Design and Implementation, Santa Clara, CA, USA, pp. 297–312 (2024)
Liu, H., Chen, B., et al.: Virtualization solution for fast storage based on RoCE+P2P technology in heterogeneous environment. In: 6th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China, vol. 6, pp. 620–625 (2023)
Top 500 The List. http://www.top500.org/. Accessed 15 Sept 2023
Hurwitz, J., Feng, W.C.: End-to-End performance of 10-gigabit ethernet on commodity systems. IEEE Micro 24(1), 10–22 (2004)
Mellanox technologies. white paper, introduction to infiniband. http://www.mellanox.com/pdf/ whitepapers/IB_Intro_WP_190.pdf. Accessed 23 Mar 2024
Liu, P., Guitart, J.: Performance characterization of containerization for HPC workloads on InfiniBand clusters: an empirical study. Cluster Comput. 25, 847–868 (2022)
Merritt R. RapidIO nudges ARM into servers. http://www.eetimes.com/docu-ment.asp?doc_id=1318957. Accessed 23 Mar 2024
Amd-SeaMicro technology overview. http://www.seamicro.com/sites/default/files/SM_TO01_64_v2.7.pdf. Accessed 23 Mar 2024
Intel Quickpath Interconnect Maximizes Multi-Core Performance. http://www.intel.com/content/www/us/en/io/quickpath-technology/quickpath-technology-general.html. Accessed 23 Mar 2024
HyperTransport Overview. http://www.hypertransport.org/default.cfm?page=technology. Accessed 23 Mar 2024
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, Z., Xianyu, Y., Xia, C. (2025). PCIe-Based Multi-node Efficient Interconnection Mechanism Design. In: Yan, L., Duan, H., Deng, Y. (eds) Advances in Guidance, Navigation and Control. ICGNC 2024. Lecture Notes in Electrical Engineering, vol 1349. Springer, Singapore. https://doi.org/10.1007/978-981-96-2248-1_52
Download citation
DOI: https://doi.org/10.1007/978-981-96-2248-1_52
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-96-2247-4
Online ISBN: 978-981-96-2248-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)