[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3394486.3403140acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Adaptive Graph Encoder for Attributed Graph Embedding

Published: 20 August 2020 Publication History

Abstract

Attributed graph embedding, which learns vector representations from graph topology and node features, is a challenging task for graph analysis. Recently, methods based on graph convolutional networks (GCNs) have made great progress on this task. However,existing GCN-based methods have three major drawbacks. Firstly,our experiments indicate that the entanglement of graph convolutional filters and weight matrices will harm both the performance and robustness. Secondly, we show that graph convolutional filters in these methods reveal to be special cases of generalized Laplacian smoothing filters, but they do not preserve optimal low-pass characteristics. Finally, the training objectives of existing algorithms are usually recovering the adjacency matrix or feature matrix, which are not always consistent with real-world applications. To address these issues, we propose Adaptive Graph Encoder (AGE), a novel attributed graph embedding framework. AGE consists of two modules: (1) To better alleviate the high-frequency noises in the node features, AGE first applies a carefully-designed Laplacian smoothing filter. (2) AGE employs an adaptive encoder that iteratively strengthens the filtered features for better node embeddings. We conduct experiments using four public benchmark datasets to validate AGE on node clustering and link prediction tasks. Experimental results show that AGE consistently outperforms state-of-the-artgraph embedding methods considerably on these tasks.

Supplementary Material

MP4 File (3394486.3403140.mp4)
Presentation Video for KDD 2020 Research Track paper "Adaptive Graph Encoder for Attributed Graph Embedding"

References

[1]
Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009. Curriculum learning. In Proceedings of ICML. 41--48.
[2]
Aleksandar Bojchevski and Stephan Günnemann. 2018. Bayesian robust attributed graph clustering: Joint learning of partial anomalies and group structure. In Proceedings of AAAI. 2738--2745.
[3]
Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2015. Grarep: Learning graph representations with global structural information. In Proceedings of CIKM. 891--900.
[4]
Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2016. Deep neural networks for learning graph representations. In Proceedings of AAAI. 1145--1152.
[5]
Jonathan Chang and David Blei. 2009. Relational topic models for document networks. In Artificial Intelligence and Statistics. 81--88.
[6]
Jianlong Chang, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, and Chunhong Pan. 2017. Deep adaptive image clustering. In Proceedings of ICCV. 5879--5887.
[7]
Fan RK Chung and Fan Chung Graham. 1997. Spectral graph theory. American Mathematical Soc.
[8]
David L Davies and DonaldWBouldin. 1979. A cluster separation measure. IEEE transactions on pattern analysis and machine intelligence 2 (1979), 224--227.
[9]
Guojun Gan, Chaoqun Ma, and Jianhong Wu. 2007. Data clustering: Theory, algorithms, and applications. Vol. 20. Siam.
[10]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of SIGKDD. 855--864.
[11]
William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation learning on graphs: Methods and applications. IEEE Data(base) Engineering Bulletin 40, 3 (2017), 52--74.
[12]
Matthew B Hastings. 2006. Community detection as an inference problem. Physical Review E 74, 3 (2006), 035--102.
[13]
Roger A Horn and Charles R Johnson. 2012. Matrix analysis. Cambridge university press.
[14]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of ICLR. 15.
[15]
Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. In NIPS Workshop on Bayesian Deep Learning. 3.
[16]
Thomas N Kipf and MaxWelling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of ICLR. 14.
[17]
Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of ICML. 1188--1196.
[18]
Qimai Li, Zhichao Han, and Xiao-Ming Wu. 2018. Deeper insights into graph convolutional networks for semi-supervised learning. In Proceedings of AAAI. 3538--3545.
[19]
Ye Li, Chaofeng Sha, Xin Huang, and Yanchun Zhang. 2018. Community detection in attributed graphs: an embedding approach. In Proceedings of AAAI. 338--345.
[20]
Stuart Lloyd. 1982. Least squares quantization in PCM. IEEE transactions on information theory 28, 2 (1982), 129--137.
[21]
Mark EJ Newman. 2006. Finding community structure in networks using the eigenvectors of matrices. Physical review E 74, 3 (2006), 036--104.
[22]
Andrew Y Ng, Michael I Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In Proceedings of NIPS. 849--856.
[23]
Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, Lina Yao, and Chengqi Zhang. 2018. Adversarially regularized graph autoencoder for graph embedding. In Proceedings of IJCAI. 2609--2615.
[24]
Jiwoong Park, Minsik Lee, Hyung Jin Chang, Kyuewang Lee, and Jin Young Choi. 2019. Symmetric graph convolutional autoencoder for unsupervised graph representation learning. In Proceedings of ICCV. 6519--6528.
[25]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of SIGKDD. 701--710.
[26]
Prithviraj Sen, Galileo Namata, Mustafa Bilgic, Lise Getoor, Brian Galligher, and Tina Eliassi-Rad. 2008. Collective classification in network data. AI magazine 29, 3 (2008), 93--93.
[27]
Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale information network embedding. In Proceedings ofWWW. 1067--1077.
[28]
Gabriel Taubin. 1995. A signal processing approach to fair surface design. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. 351--358.
[29]
Laurens Van Der Maaten. 2014. Accelerating t-SNE using tree-based algorithms. The journal of machine learning research 15, 1 (2014), 3221--3245.
[30]
, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2018. Graph attention networks. In Proceedings of ICLR. 8.
[31]
ChunWang, Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, and Chengqi Zhang. 2019. Attributed graph clustering: A deep attentional embedding approach. In Proceedings of IJCAI. 3670--3676.
[32]
Chun Wang, Shirui Pan, Guodong Long, Xingquan Zhu, and Jing Jiang. 2017. Mgae: Marginalized graph autoencoder for graph clustering. In Proceedings of CIKM. 889--898.
[33]
Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural deep network embedding. In Proceedings of SIGKDD. 1225--1234.
[34]
Xiao Wang, Di Jin, Xiaochun Cao, Liang Yang, and Weixiong Zhang. 2016. Semantic community identification in large attribute networks. In Proceedings of AAAI. 265--271.
[35]
Felix Wu, Tianyi Zhang, Amauri Holanda de Souza Jr, Christopher Fifty, Tao Yu, and Kilian Q Weinberger. 2019. Simplifying graph convolutional networks. In Proceedings of ICML. 6861--6871.
[36]
Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Chang. 2015. Network representation learning with rich text information. In Proceedings of IJCAI. 2111--2117.
[37]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of SIGKDD. 974--983.
[38]
Xiaotong Zhang, Han Liu, Qimai Li, and Xiao-Ming Wu. 2019. Attributed graph clustering via adaptive graph convolution. In Proceedings of IJCAI. 4327--4333.
[39]
Jie Zhou, Ganqu Cui, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. 2018. Graph neural networks: A review of methods and applications. arXiv preprint arXiv:1812.08434 (2018).

Cited By

View all
  • (2025)Multi-view attributed graph clustering based on graph diffusion convolution with adaptive fusionExpert Systems with Applications10.1016/j.eswa.2024.125286260(125286)Online publication date: Jan-2025
  • (2024)Adaptive Multi-Channel Deep Graph Neural NetworksSymmetry10.3390/sym1604040616:4(406)Online publication date: 1-Apr-2024
  • (2024)SGAAE-AC: A Semi-Supervised Graph Attention Autoencoder for Electroencephalography (EEG) Age ClusteringApplied Sciences10.3390/app1413539214:13(5392)Online publication date: 21-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
August 2020
3664 pages
ISBN:9781450379984
DOI:10.1145/3394486
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 August 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive learning
  2. attributed graph embedding
  3. graph convolutional networks
  4. laplacian smoothing

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China

Conference

KDD '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)363
  • Downloads (Last 6 weeks)40
Reflects downloads up to 11 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2025)Multi-view attributed graph clustering based on graph diffusion convolution with adaptive fusionExpert Systems with Applications10.1016/j.eswa.2024.125286260(125286)Online publication date: Jan-2025
  • (2024)Adaptive Multi-Channel Deep Graph Neural NetworksSymmetry10.3390/sym1604040616:4(406)Online publication date: 1-Apr-2024
  • (2024)SGAAE-AC: A Semi-Supervised Graph Attention Autoencoder for Electroencephalography (EEG) Age ClusteringApplied Sciences10.3390/app1413539214:13(5392)Online publication date: 21-Jun-2024
  • (2024)STGIC: A graph and image convolution-based method for spatial transcriptomic clusteringPLOS Computational Biology10.1371/journal.pcbi.101193520:2(e1011935)Online publication date: 28-Feb-2024
  • (2024)A novel hierarchical network-based approach to unveil the complexity of functional microbial genomeBMC Genomics10.1186/s12864-024-10692-625:1Online publication date: 14-Aug-2024
  • (2024)Towards Faster Deep Graph Clustering via Efficient Graph Auto-EncoderACM Transactions on Knowledge Discovery from Data10.1145/367498318:8(1-23)Online publication date: 16-Aug-2024
  • (2024)Attribute Diversity Aware Community Detection on Attributed Graphs Using Three-View Graph Attention Neural NetworksACM Transactions on Knowledge Discovery from Data10.1145/367208118:8(1-24)Online publication date: 12-Jun-2024
  • (2024)GraphLearner: Graph Node Clustering with Fully Learnable AugmentationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680602(5517-5526)Online publication date: 28-Oct-2024
  • (2024)GraphControl: Adding Conditional Control to Universal Graph Pre-trained Models for Graph Domain Transfer LearningProceedings of the ACM Web Conference 202410.1145/3589334.3645439(539-550)Online publication date: 13-May-2024
  • (2024)Deep Adaptive Graph Clustering via von Mises-Fisher DistributionsACM Transactions on the Web10.1145/358052118:2(1-21)Online publication date: 8-Jan-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media