[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3340531.3411875acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

NagE: Non-Abelian Group Embedding for Knowledge Graphs

Published: 19 October 2020 Publication History

Abstract

We demonstrated the existence of a group algebraic structure hidden in relational knowledge embedding problems, which suggests that a group-based embedding framework is essential for designing embedding models. Our theoretical analysis explores merely the intrinsic property of the embedding problem itself hence is model independent. Motivated by the theoretical analysis, we have proposed a group theory-based knowledge graph embedding framework, in which relations are embedded as group elements, and entities are represented by vectors in group action spaces. We provide a generic recipe to construct embedding models associated with two instantiating examples: SO3E and SU2E, both of which apply a continuous non-Abelian group as the relation embedding. Empirical experiments using these two exampling models have shown state-of-the-art results on benchmark datasets.

Supplementary Material

MP4 File (3340531.3411875.mp4)
We demonstrated the existence of a group algebraic structure hid-den in relational knowledge embedding problems, which suggests that a group-based embedding framework is essential for designing embedding models. Our theoretical analysis explores merely the intrinsic property of the embedding problem itself hence is model-independent. Motivated by the theoretical analysis, we have proposed a group theory-based knowledge graph embedding frame-work, in which relations are embedded as group elements, and entities are represented by vectors in group action spaces. We provide a generic recipe to construct embedding models associated with two instantiating examples: SO3E and SU2E, both of which apply a continuous non-Abelian group as the relation embedding. Empirical experiments using these two exampling models have shown state-of-the-art results on benchmark datasets.

References

[1]
Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008. Freebase: a collaboratively created graph database for structuring human knowledge. In In SIGMOD Conference. 1247--1250.
[2]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2 (NIPS'13). Curran Associates Inc., USA, 2787--2795. http://dl.acm.org/citation.cfm?id=2999792.2999923
[3]
Chen Cai. 2019. Group Representation Theory for Knowledge Graph Embedding. arXiv preprint arXiv:1909.05100 (2019).
[4]
Tim Dettmers, Minervini Pasquale, Stenetorp Pontus, and Sebastian Riedel. 2018. Convolutional 2D Knowledge Graph Embeddings. In Proceedings of the 32th AAAI Conference on Artificial Intelligence. 1811--1818. https://arxiv.org/abs/1707.01476
[5]
Takuma Ebisu and Ryutaro Ichise. 2018. TorusE: Knowledge Graph Embedding on a Lie Group. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2--7, 2018. 1819--1826. https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16227
[6]
B. Hall and B.C. Hall. 2003. Lie Groups, Lie Algebras, and Representations: An Elementary Introduction. Springer. https://books.google.com/books?id= m1VQi8HmEwcC
[7]
Yanchao Hao, Yuanzhe Zhang, Kang Liu, Shizhu He, Zhanyi Liu, Hua Wu, and Jun Zhao. 2017. An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Vancouver, Canada, 221--231. https://doi.org/10.18653/v1/P17--1021
[8]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980 (2014).
[9]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI'15). AAAI Press, 2181--2187. http://dl.acm.org/citation.cfm?id=2886521.2886624
[10]
George A. Miller. 1995. WordNet: A Lexical Database for English. Commun. ACM 38, 11 (Nov. 1995), 39--41. https://doi.org/10.1145/219717.219748
[11]
Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen, and Dinh Phung. 2017. A novel embedding model for knowledge base completion based on convolutional neural network. arXiv preprint arXiv:1712.02121 (2017).
[12]
Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2011. A Three-way Model for Collective Learning on Multi-relational Data. In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML'11). Omnipress, USA, 809--816. http://dl.acm.org/citation.cfm?id=3104482. 3104584
[13]
Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. In International Conference on Learning Representations. https://openreview.net/forum?id= HkgEQnRqYQ
[14]
Kristina Toutanova and Danqi Chen. 2015. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality. Association for Computational Linguistics, Beijing, China, 57--66. https://doi.org/10.18653/v1/W15--4007
[15]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48 (ICML'16). JMLR.org, 2071--2080. http://dl.acm.org/citation. cfm?id=3045390.3045609
[16]
Canran Xu and Ruijiang Li. 2019. Relation Embedding with Dihedral Group in Knowledge Graph. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 263--272. https://doi.org/10.18653/v1/P19--1026
[17]
Bishan Yang, Wen tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2014. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. CoRR abs/1412.6575 (2014).
[18]
Shuai Zhang, Yi Tay, Lina Yao, and Qi Liu. 2019. Quaternion knowledge graph embeddings. In Advances in Neural Information Processing Systems. 2731--2741.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management
October 2020
3619 pages
ISBN:9781450368599
DOI:10.1145/3340531
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. knowledge graph
  2. knowledge representation
  3. relational graph
  4. representation learning

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation

Conference

CIKM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)1
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Knowledge Graph Embedding: A Survey from the Perspective of Representation SpacesACM Computing Surveys10.1145/3643806Online publication date: 2-Feb-2024
  • (2024)TracKGEKnowledge-Based Systems10.1016/j.knosys.2024.112218301:COnline publication date: 9-Oct-2024
  • (2023)Knowledge graph embedding with the special orthogonal group in quaternion space for link predictionKnowledge-Based Systems10.1016/j.knosys.2023.110400266:COnline publication date: 22-Apr-2023
  • (2022)Knowledgebra: An Algebraic Learning Framework for Knowledge GraphMachine Learning and Knowledge Extraction10.3390/make40200194:2(432-445)Online publication date: 5-May-2022
  • (2022)DensENeurocomputing10.1016/j.neucom.2021.12.079476:C(115-125)Online publication date: 1-Mar-2022
  • (2022)STaR: Knowledge Graph Embedding by Scaling, Translation and RotationArtificial Intelligence and Mobile Services – AIMS 202210.1007/978-3-031-23504-7_3(31-45)Online publication date: 10-Dec-2022
  • (2021)Knowledge Graph Representation Learning as GroupoidProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482442(2311-2320)Online publication date: 26-Oct-2021
  • (2021)HopfEProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482263(89-99)Online publication date: 26-Oct-2021
  • (2020)3D Learning and Reasoning in Link Prediction Over Knowledge GraphsIEEE Access10.1109/ACCESS.2020.30341838(196459-196471)Online publication date: 2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media