Abstract
R-GCN (Relational Graph Convolutional Network) is one of GNNs (Graph Neural Networks). The model tries predicting latent information by considering directions and types of edges in graph-structured data, such as knowledge bases. The model builds weight matrices to each edge attribute. Thus, the size of the neural network increases linearly with the number of edge types. Although GPUs can be used for accelerating the R-GCN processing, there is a possibility that the size of weight matrices exceeds GPU device memory. To address this issue, in this paper, an edge attribute-wise partitioning is proposed for R-GCN. The proposed partitioning divides the model and graph data so that R-GCN can be accelerated by using multiple GPUs. Also, the proposed approach can be applied to sequential execution on a single GPU. Both the cases can accelerate the R-GCN processing with large graph data, where the original model cannot be fit into a device memory of a single GPU without partitioning. Experimental results demonstrate that our partitioning method accelerates R-GCN by up to 3.28 times using four GPUs compared to CPU execution for a dataset with more than 1.6 million nodes and 5 million edges. Also, the proposed approach can accelerate the execution even with a single GPU by 1.55 times compared to the CPU execution for a dataset with 0.8 million nodes and 2 million edges.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Deep Graph Library. https://www.dgl.ai/pages/about.html
Albert, R., Barabasi, A.L.: Statistical Mechanics of Complex Networks. Rev. Mod. Phys. 74, 47 (2002)
Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on largegraphs. In: Proceedings of the Neural Information Processing Systems (NeurIPS 2017), pp. 1024–1034 (2017)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of the International Conference on Learning Representations (ICLR 2017) (2017)
Ristoski, P., de Vries, G.K.D., Paulheim, H.: A collection of benchmark datasets for systematic evaluations of machine learning on the semantic web. In: Groth, P., et al. (eds.) ISWC 2016. LNCS, vol. 9982, pp. 186–194. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46547-0_20
Schlichtkrull, M., Kipf, T.N., Bloem, P., Berg, R.V.d., Titov, I., Welling, M.: Modeling relational data with graph convolutinal networks. arXiv preprint arXiv:1703.06103v4, October 2017
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Yu, P.S.: A comprehensive survey on graph neural networks. arXiv:1901.00596v4, March 2019
Xu, K., Hu, W., Leskovec, J., Jegelka, S.: How powerful are graph neural networks. In: Proceedings of the International Conference on Learning Representations (ICLR 2019) (2019)
Ye, R., Yujie Fang, H.Z., Wang, M.: A vectorized relational graph convolutional network for multi-relational network alignment. In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI 2019), pp. 4135–4141 (2019)
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the International Conference on Knowledge Discovery & Data Mining (KDD 2018), pp. 974–983, August 2018
Acknowledgements
This work was partially supported by JSPS KAKENHI Grant Number JP19H04117.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kibata, T., Tsukada, M., Matsutani, H. (2021). An Edge Attribute-Wise Partitioning and Distributed Processing of R-GCN Using GPUs. In: Balis, B., et al. Euro-Par 2020: Parallel Processing Workshops. Euro-Par 2020. Lecture Notes in Computer Science(), vol 12480. Springer, Cham. https://doi.org/10.1007/978-3-030-71593-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-71593-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-71592-2
Online ISBN: 978-3-030-71593-9
eBook Packages: Computer ScienceComputer Science (R0)