More Web Proxy on the site http://driver.im/

research-article

Deep Partial Multiplex Network Embedding

Authors:

Anirudh Ravula,

Dongfang LiuAuthors Info & Claims

WWW '22: Companion Proceedings of the Web Conference 2022

Pages 1053 - 1062

https://doi.org/10.1145/3487553.3524717

Published: 16 August 2022 Publication History

Abstract

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has been increasing interest in network embedding on multiplex data. However, most existing multiplex approaches assume that the data is complete in all views. But in real applications, it is often the case that each view suffers from the missing of some data and therefore results in partial multiplex data.

In this paper, we present a novel Deep Partial Multiplex Network Embedding approach to deal with incomplete data. In particular, the network embeddings are learned by simultaneously minimizing the deep reconstruction loss with the autoencoder neural network, enforcing the data consistency across views via common latent subspace learning, and preserving the data topological structure within the same network through graph Laplacian. We further prove the orthogonal invariant property of the learned embeddings and connect our approach with the binary embedding techniques. Experiments on four multiplex benchmarks demonstrate the superior performance of the proposed approach over several state-of-the-art methods on node classification, link prediction and clustering tasks.

References

[1]

Mohammadreza Armandpour, Patrick Ding, Jianhua Huang, and Xia Hu. 2019. Robust Negative Sampling for Network Embedding. In AAAI. 3191–3198.

[2]

Sambaran Bandyopadhyay, Lokesh N, Saley Vishal Vivek, and M. Narasimha Murty. 2020. Outlier Resistant Unsupervised Deep Architectures for Attributed Network Embedding. In WSDM. 25–33.

[3]

Mikhail Belkin and Partha Niyogi. 2001. Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. In NIPS. 585–591.

[4]

Ayan Kumar Bhowmick, Koushik Meneni, Maximilien Danisch, Jean-Loup Guillaume, and Bivas Mitra. 2020. LouvainNE: Hierarchical Louvain Method for High Quality and Scalable Network Embedding. In WSDM. 43–51.

[5]

Ngot Bui, Thanh Le, and Vasant G. Honavar. 2016. Labeling actors in multi-view social networks by integrating information from within and across multiple views. In BigData. 616–625.

[6]

Yukuo Cen, Xu Zou, Jianwei Zhang, Hongxia Yang, Jingren Zhou, and Jie Tang. 2019. Representation Learning for Attributed Multiplex Heterogeneous Network. In SIGKDD. 1358–1368.

[7]

Shiyu Chang, Wei Han, Jiliang Tang, Guo-Jun Qi, Charu C. Aggarwal, and Thomas S. Huang. 2015. Heterogeneous Network Embedding via Deep Architectures. In SIGKDD. 119–128.

[8]

Weijian Chen, Fuli Feng, Qifan Wang, Xiangnan He, Chonggang Song, Guohui Ling, and Yongdong Zhang. 2021. CatGCN: Graph Convolutional Networks with Categorical Node Features. IEEE Transactions on Knowledge and Data Engineering (2021).

[9]

Xia Chen, Guoxian Yu, Jun Wang, Carlotta Domeniconi, Zhao Li, and Xiangliang Zhang. 2019. ActiveHNE: Active Heterogeneous Network Embedding. In IJCAI. 2123–2129.

[10]

Jiafeng Cheng, Qianqian Wang, Zhiqiang Tao, De-Yan Xie, and Quanxue Gao. 2020. Multi-View Attribute Graph Convolution Networks for Clustering. In IJCAI. 2973–2979.

[11]

Calin Cruceru, Gary Bécigneul, and Octavian-Eugen Ganea. 2021. Computationally Tractable Riemannian Manifolds for Graph Embeddings. In AAAI.

[12]

Lun Du, Zhicong Lu, Yun Wang, Guojie Song, Yiming Wang, and Wei Chen. 2018. Galaxy Network Embedding: A Hierarchical Community Structure Preserving Approach. In IJCAI. 2079–2085.

[13]

Fuli Feng, Weiran Huang, Xiangnan He, Xin Xin, Qifan Wang, and Tat-Seng Chua. 2021. Should graph convolution trust neighbors? a simple causal inference method. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1208–1218.

Digital Library

[14]

Ming-Han Feng, Chin-Chi Hsu, Cheng-Te Li, Mi-Yen Yeh, and Shou-De Lin. 2019. MARINE: Multi-relational Network Embeddings with Relational Proximity and Node Attributes. In WWW. 470–479.

[15]

Xinyu Fu, Jiani Zhang, Ziqiao Meng, and Irwin King. 2020. MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding. In WWW. 2331–2341.

[16]

Hongchang Gao and Heng Huang. 2018. Deep Attributed Network Embedding. In IJCAI. 3364–3370.

[17]

Hongchang Gao, Jian Pei, and Heng Huang. 2019. ProGAN: Network Embedding via Proximity Generative Adversarial Network. In SIGKDD. 1308–1316.

[18]

Lin Gong, Lu Lin, Weihao Song, and Hongning Wang. 2020. JNET: Learning User Representations via Joint Network Embedding and Topic Embedding. In WSDM. 205–213.

[19]

Yunchao Gong, Qifa Ke, Michael Isard, and Svetlana Lazebnik. 2014. A Multi-View Embedding Space for Modeling Internet Images, Tags, and Their Semantics. Int. J. Comput. Vis. 106, 2 (2014), 210–233.

Digital Library

[20]

Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. 2013. Iterative Quantization: A Procrustean Approach to Learning Binary Codes for Large-Scale Image Retrieval. TPAMI 35, 12 (2013), 2916–2929.

Digital Library

[21]

Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable Feature Learning for Networks. In SIGKDD. 855–864.

[22]

Jun Guo and Jiahui Ye. 2019. Anchors Bring Ease: An Embarrassingly Simple Approach to Partial Multi-View Clustering. In AAAI. 118–125.

[23]

William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. In NIPS. 1024–1034.

[24]

Ziniu Hu, Yuxiao Dong, Kuansan Wang, and Yizhou Sun. 2020. Heterogeneous Graph Transformer. In WWW. 2704–2710.

[25]

Qing-Yuan Jiang and Wu-Jun Li. 2017. Deep Cross-Modal Hashing. In CVPR. 3270–3278.

[26]

Song Jiang, Bernard Koch, and Yizhou Sun. 2021. HINTS: Citation Time Series Prediction for New Publications via Dynamic Heterogeneous Information Network Embedding. In WWW. 3158–3167.

[27]

Wenhao Jiang, Hongchang Gao, Fu-Lai Chung, and Heng Huang. 2016. The l2, 1-Norm Stacked Robust Autoencoders for Domain Adaptation. In AAAI. 1723–1729.

[28]

Pan Li, Yanbang Wang, Hongwei Wang, and Jure Leskovec. 2020. Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation Learning. In NeurIPS. 4465–4478.

[29]

Shao-Yuan Li, Yuan Jiang, and Zhi-Hua Zhou. 2014. Partial Multi-View Clustering. In AAAI. 1968–1974.

[30]

Xiaohe Li, Lijie Wen, Chen Qian, and Jianmin Wang. 2020. GAHNE: Graph-Aggregated Heterogeneous Network Embedding. CoRR abs/2012.12517(2020).

[31]

Yu Li, Ying Wang, Tingting Zhang, Jiawei Zhang, and Yi Chang. 2019. Learning Network Embedding with Community Structural Information. In IJCAI. 2937–2943.

[32]

Xinwang Liu, Miaomiao Li, Chang Tang, Jingyuan Xia, Jian Xiong, Li Liu, Marius Kloft, and En Zhu. 2020. Efficient and Effective Regularized Incomplete Multi-view Clustering. In TPAMI.

[33]

Zhijun Liu, Chao Huang, Yanwei Yu, and Junyu Dong. 2021. Motif-Preserving Dynamic Attributed Network Embedding. In WWW. 1629–1638.

[34]

Zaiqiao Meng, Shangsong Liang, Hongyan Bao, and Xiangliang Zhang. 2019. Co-Embedding Attributed Networks. In WSDM. 393–401.

[35]

Guosheng Pan, Yuan Yao, Hanghang Tong, Feng Xu, and Jian Lu. 2021. Unsupervised Attributed Network Embedding via Cross Fusion. In WSDM. 797–805.

[36]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In SIGKDD. 701–710.

[37]

Léo Pio-Lopez, Alberto Valdeolivas, Laurent Tichit, Elisabeth Remy, and Anaïs Baudot. 2020. MultiVERSE: a multiplex and multiplex-heterogeneous network embedding approach. CoRR abs/2008.10085(2020).

[38]

Meng Qu, Jian Tang, Jingbo Shang, Xiang Ren, Ming Zhang, and Jiawei Han. 2017. An Attention-based Collaboration Framework for Multi-View Network Representation Learning. In CIKM. 1767–1776.

[39]

Nishant Rai, Sumit Negi, Santanu Chaudhury, and Om Deshmukh. 2016. Partial Multi-View Clustering using Graph Regularized NMF. In ICPR. 2192–2197.

[40]

Ruslan Salakhutdinov and Geoffrey E. Hinton. 2009. Semantic hashing. Int. J. Approx. Reason. 50, 7 (2009), 969–978.

Digital Library

[41]

Yu Shi, Fangqiu Han, Xinran He, Carl Yang, Jie Luo, and Jiawei Han. 2018. mvn2vec: Preservation and Collaboration in Multi-View Network Embedding. CoRR abs/1801.06597(2018).

[42]

Xiangguo Sun, Hongzhi Yin, Bo Liu, Hongxu Chen, Jiuxin Cao, Yingxia Shao, and Nguyen Quoc Viet Hung. 2021. Heterogeneous Hypergraph Embedding for Graph Classification. In WSDM. 725–733.

[43]

Yiwei Sun, Suhang Wang, Tsung-Yu Hsieh, Xianfeng Tang, and Vasant G. Honavar. 2019. MEGAN: A Generative Adversarial Network for Multi-View Network Embedding. In IJCAI. 3527–3533.

[44]

Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. LINE: Large-scale Information Network Embedding. In WWW. 1067–1077.

Digital Library

[45]

Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. 2008. ArnetMiner: extraction and mining of academic social networks. In SIGKDD. 990–998.

[46]

Ke Tu, Peng Cui, Xiao Wang, Philip S. Yu, and Wenwu Zhu. 2018. Deep Recursive Network Embedding with Regular Equivalence. In SIGKDD. 2357–2366.

[47]

Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural Deep Network Embedding. In SIGKDD. 1225–1234.

[48]

Jingdong Wang, Ting Zhang, Jingkuan Song, Nicu Sebe, and Heng Tao Shen. 2018. A Survey on Learning to Hash. TPAMI 40, 4 (2018), 769–790.

[49]

Qifan Wang. 2015. Learning compact hashing codes with complex objectives from multiple sources for large scale similarity search. Ph.D. Dissertation. Purdue University.

[50]

Qifan Wang, Gal Chechik, Chen Sun, and Bin Shen. 2017. Instance-level label propagation with multi-instance learning. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2943–2949.

[51]

Qianqian Wang, Zhengming Ding, Zhiqiang Tao, Quanxue Gao, and Yun Fu. 2020. Generative Partial Multi-View Clustering. CoRR abs/2003.13088(2020).

[52]

Qifan Wang, Yi Fang, Anirudh Ravula, Fuli Feng, Xiaojun Quan, and Dongfang Liu. 2022. WebFormer: The Web-page Transformer for Structure Information Extraction. In WWW.

[53]

Qifan Wang and Ruining He. 2021. Deep Multi-View Network Embedding on Incomplete Data. US Patent App. 17/154,123.

[54]

Qifan Wang, Luo Si, and Bin Shen. 2015. Learning to Hash on Partial Multi-Modal Data. In IJCAI. 3904–3910.

[55]

Suhang Wang, Jiliang Tang, Charu C. Aggarwal, and Huan Liu. 2016. Linked Document Embedding for Classification. In CIKM. 115–124.

[56]

Weiran Wang, Raman Arora, Karen Livescu, and Jeff A. Bilmes. 2015. On Deep Multi-View Representation Learning. In ICML. 1083–1092.

[57]

Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S. Yu. 2019. Heterogeneous Graph Attention Network. In WWW. 2022–2032.

[58]

Zekai Wang, Hongzhi Liu, Yingpeng Du, Zhonghai Wu, and Xing Zhang. 2019. Unified Embedding Model over Heterogeneous Information Network for Personalized Recommendation. In IJCAI. 3813–3819.

[59]

Xiaokai Wei, Bokai Cao, Weixiang Shao, Chun-Ta Lu, and Philip S. Yu. 2016. Community detection with partially observable links and node attributes. In BigData.

[60]

Jiancan Wu, Xiangnan He, Xiang Wang, Qifan Wang, Weijian Chen, Jianxun Lian, and Xing Xie. 2022. Graph convolution machine for context-aware recommender system. Frontiers of Computer Science 16, 6 (2022), 1–12.

Digital Library

[61]

Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S. Yu. 2021. A Comprehensive Survey on Graph Neural Networks. IEEE Trans. Neural Networks Learn. Syst. 32, 1 (2021), 4–24.

[62]

Yuanzhen Xie, Zijing Ou, Liang Chen, Yang Liu, Kun Xu, Carl Yang, and Zibin Zheng. 2021. Learning and Updating Node Embedding on Dynamic Heterogeneous Information Network. In WSDM. 184–192.

[63]

Cai Xu, Ziyu Guan, Wei Zhao, Hongchang Wu, Yunfei Niu, and Beilei Ling. 2019. Adversarial Incomplete Multi-view Clustering. In IJCAI. 3933–3939.

[64]

Hansheng Xue, Luwei Yang, Vaibhav Rajan, Wen Jiang, Yi Wei, and Yu Lin. 2021. Multiplex Bipartite Network Embedding using Dual Hypergraph Convolutional Networks. In WWW. 1649–1660.

[65]

Yuchen Yan, Si Zhang, and Hanghang Tong. 2021. BRIGHT: A Bridging Algorithm for Network Alignment. In WWW. 3907–3917.

[66]

Carl Yang, Aditya Pal, Andrew Zhai, Nikil Pancha, Jiawei Han, Charles Rosenberg, and Jure Leskovec. 2020. MultiSage: Empowering GCN with Contextualized Multi-Embeddings on Web-Scale Multipartite Networks. In SIGKDD. 2434–2443.

[67]

Carl Yang, Yuxin Xiao, Yu Zhang, Yizhou Sun, and Jiawei Han. 2020. Heterogeneous Network Representation Learning: Survey, Benchmark, Evaluation, and Beyond. CoRR abs/2004.00216(2020).

[68]

Li Yang, Qifan Wang, Zac Yu, Anand Kulkarni, Sumit Sanghai, Bin Shu, Jon Elsas, and Bhargav Kanagal. 2022. MAVE: A Product Dataset for Multi-Source Attribute Value Extraction. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1256–1265.

Digital Library

[69]

Daokun Zhang, Jie Yin, Xingquan Zhu, and Chengqi Zhang. 2018. SINE: Scalable Incomplete Network Embedding. In ICDM. 737–746.

[70]

Hongming Zhang, Liwei Qiu, Lingling Yi, and Yangqiu Song. 2018. Scalable Multiplex Network Embedding. In IJCAI. 3082–3088.

[71]

Xinyuan Zhang, Yitong Li, Dinghan Shen, and Lawrence Carin. 2018. Diffusion Maps for Textual Network Embedding. In NIPS. 7598–7608.

[72]

Yizhou Zhang, Guojie Song, Lun Du, Shuwen Yang, and Yilun Jin. 2019. DANE: Domain Adaptive Network Embedding. In IJCAI. 4362–4368.

[73]

Jianan Zhao, Xiao Wang, Chuan Shi, Zekuan Liu, and Yanfang Ye. 2020. Network Schema Preserving Heterogeneous Information Network Embedding. In IJCAI, Christian Bessiere (Ed.). 1366–1372.

[74]

Shijie Zhu, Jianxin Li, Hao Peng, Senzhang Wang, Philip S. Yu, and Lifang He. 2021. Adversarial Directed Graph Embedding. In AAAI. 4741–4748.

Cited By

Wang CTang Z(2024)The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised FrameworkIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.329497734:8(6646-6660)Online publication date: Aug-2024
https://doi.org/10.1109/TCSVT.2023.3294977
Tang JYi QFu STian Y(2024)Incomplete multi-view learningApplied Soft Computing10.1016/j.asoc.2024.111278153:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.asoc.2024.111278
Chen KQiu YLiu ZMu W(2024)Layer imbalance-aware multiplex network embeddingKnowledge and Information Systems10.1007/s10115-024-02072-z66:6(3547-3569)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.1007/s10115-024-02072-z

Index Terms

Deep Partial Multiplex Network Embedding
1. Information systems
  1. World Wide Web
    1. Web searching and information discovery

Recommendations

Multiplex Heterogeneous Graph Convolutional Network
KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining

Heterogeneous graph convolutional networks have gained great popularity in tackling various network analytical tasks on heterogeneous network data, ranging from link prediction to node classification. However, most existing works ignore the relation ...
Structural Deep Network Embedding
KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Network embedding is an important method to learn low-dimensional representations of vertexes in networks, aiming to capture and preserve the network structure. Almost all the existing network embedding methods adopt shallow models. However, since the ...
A synchronous feature learning method for multiplex network embedding
Abstract
Compared with single-layer networks, multiplex networks can describe real-world scenarios in more detail while suffering from requiring considerable computing and storage resources at the same time. Network feature learning, which aims ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Companion Proceedings of the Web Conference 2022

April 2022

1338 pages

ISBN:9781450391306

DOI:10.1145/3487553

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Lionel Médini
Université Lyon 1, France
,
Ivan Herman
W3C / retired

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)7

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang CTang Z(2024)The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised FrameworkIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.329497734:8(6646-6660)Online publication date: Aug-2024
https://doi.org/10.1109/TCSVT.2023.3294977
Tang JYi QFu STian Y(2024)Incomplete multi-view learningApplied Soft Computing10.1016/j.asoc.2024.111278153:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.asoc.2024.111278
Chen KQiu YLiu ZMu W(2024)Layer imbalance-aware multiplex network embeddingKnowledge and Information Systems10.1007/s10115-024-02072-z66:6(3547-3569)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.1007/s10115-024-02072-z
Zhang JWang FZhang HShi X(2023)Compressive sensing spatially adaptive total variation method for high-noise astronomical image denoisingThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02842-w40:2(1215-1227)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1007/s00371-023-02842-w

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents