[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3404835.3462925acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completion

Published: 11 July 2021 Publication History

Abstract

Aiming at expanding few-shot relations' coverage in knowledge graphs (KGs), few-shot knowledge graph completion (FKGC) has recently gained more research interests. Some existing models employ a few-shot relation's multi-hop neighbor information to enhance its semantic representation. However, noise neighbor information might be amplified when the neighborhood is excessively sparse and no neighbor is available to represent the few-shot relation. Moreover, modeling and inferring complex relations of one-to-many (1-N), many-to-one (N-1), and many-to-many (N-N) by previous knowledge graph completion approaches requires high model complexity and a large amount of training instances. Thus, inferring complex relations in the few-shot scenario is difficult for FKGC models due to limited training instances. In this paper, we propose a few-shot relational learning with global-local framework to address the above issues. At the global stage, a novel gated and attentive neighbor aggregator is built for accurately integrating the semantics of a few-shot relation's neighborhood, which helps filtering the noise neighbors even if a KG contains extremely sparse neighborhoods. For the local stage, a meta-learning based TransH (MTransH) method is designed to model complex relations and train our model in a few-shot learning fashion. Extensive experiments show that our model outperforms the state-of-the-art FKGC approaches on the frequently-used benchmark datasets NELL-One and Wiki-One. Compared with the strong baseline model MetaR, our model achieves 5-shot FKGC performance improvements of 8.0% on NELL-One and 2.8% on Wiki-One by the metric Hits@10.

Supplementary Material

MP4 File (SIGIR21-fp0677.mp4)
Presentation video of the paper "Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completion", reported by Guanglin Niu.

References

[1]
Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1533--1544.
[2]
Kurt Bollacker, Georg Gottlob, and Sergio Flesca. 2008. Freebase: a collaboratively created graph database for structuring human knowledge. In KDD. 1247--1250.
[3]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Neural Information Processing Systems. 2787--2795.
[4]
Antoine Bordes, GlorotJason Weston, and Yoshua Bengio. 2014. A semantic matching energy function for learning with multi-relational data. Machine Learning, Vol. 94 (2014), 233--259.
[5]
Ines Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala, Sujith Ravi, and Christopher Ré. 2020. Low-Dimensional Hyperbolic Knowledge Graph Embeddings. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 6901--6914.
[6]
M. Chen, W. Zhang, W. Zhang, Q. Chen, and H. Chen. 2019. Meta relational learning for few-shot link prediction in knowledge graphs. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. 4217--4226.
[7]
Joachim Daiber, Max Jakob, Chris Hokamp, and Pablo N Mendes. 2013. Improving efficiency and accuracy in multilingual entity extraction. In Proceedings of the 9th International Conference on Semantic Systems. 121--124.
[8]
Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. 2018. Convolutional 2D knowledge graph embeddings. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence. 1811--1818.
[9]
Zhengxiao Du, Chang Zhou, Ming Ding, Hongxia Yang, and Jie Tang. 2019. Cognitive Knowledge Graph Reasoning for One-shot Relational Learning. In Arxiv.
[10]
Luis Galárraga, Christina Teflioudi, Katja Hose, and Fabian Suchanek. 2015. Fast rule mining in ontological knowledge bases with AMIE+. The VLDB Journal, Vol. 24, 6 (2015), 707--730.
[11]
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. In Proceedings of the 31st Conference on Neural Information Processing Systems.
[12]
He He, Anusha Balakrishnan, Mihail Eric, and Percy Liang. 2017. Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.
[13]
Lirong He, Bin Liu, Guangxi Li, Yongpan Sheng, Yafang Wang, and Zenglin Xu. 2018. Knowledge base completion by variational bayesian neural tensor decomposition. Cognitive Computation, Vol. 10, 6 (2018).
[14]
Shizhu He, Kang Liu, Guoliang Ji, and Jun Zhao. 2015. Learning to represent knowledge graphs with gaussian embedding. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 623--632.
[15]
Raphael Hoffmann, Congle Zhang, Xiao Ling, Luke Zettlemoyer, and Daniel S Weld. 2011. Knowledge-based weak supervision for information extraction of overlapping relations. In Proceedings of the 49nd Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. 541--550.
[16]
Xiao Huang, Jingyuan Zhang, Dingcheng Li, and Ping Li. 2019. Knowledge Graph Embedding Based Question Answering. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. 105--113.
[17]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 2181--2187.
[18]
Hanxiao Liu, Yuexin Wu, and Yiming Yang. 2017. Analogical Inference for Multirelational Embeddings. In Proceedings of the Thirty-fourth International Conference on Machine Learning Year. 2168--2178.
[19]
A.L. Maas, Awni Y. Hannun, and Andrew Y. Ng. 2013. Rectifier Nonlinearities Improve Neural Network Acoustic Models. In Proceedings of the 30th International Conference on Machine Learning.
[20]
Schlichtkrull Michael, Kipf Thomas N., Bloem Peter, van den Berg Rianne, Titov Ivan, and Welling Max. 2018. Modeling relational data with graph convolutional networks. In ESWC.
[21]
George A. Miller. 1995. WordNet: A Lexical Database for English. Commun. ACM, Vol. 38, 11 (1995), 39--41.
[22]
T. Mitchell, W. Cohen, E. Hruschka, P. Talukdar, B. Yang, J. Betteridge, A. Carlson, B. Dalvi, M. Gardner, B. Kisiel, J. Krishnamurthy, N. Lao, K. Mazaitis, T. Mohamed, N. Nakashole, E. Platanios, A. Ritter, M. Samadi, B. Settles, R. Wang, D. Wijaya, A. Gupta, X. Chen, A. Saparov, M. Greaves, and J. Welling. 2018. Never-ending learning. Commun. ACM, Vol. 61, 5 (2018), 103--115.
[23]
Deepak Nathani, Jatin Chauhan, Charu Sharma, and Manohar Kaul. 2019. Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.
[24]
Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen, and Dinh Phung. 2018. A novel embedding model for knowledge base completion based on convolutional neural network. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologiess. 327--333.
[25]
P. G. Omran, K. Wang, and Z. Wang. 2019. An embedding-based approach to rule learning in knowledge graphs. In IEEE Transactions on Knowledge and Data Engineering. 1--12.
[26]
Apoorv Saxena, Aditay Tripathi, and Partha Talukdar. 2020. Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (2020).
[27]
Jiawei Sheng, Shu Guo, Zhenyu Chen, Juwei Yue, Lihong Wang, Tingwen Liu, and Hongbo Xu. 2020. Adaptive Attentional Network for Few-Shot Knowledge Graph Completion. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 1681--1691.
[28]
Fabian M Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2007. Yago: a core of semantic knowledge. In Proceedings of the 16th International Conference on World Wide Web. ACM, 697--706.
[29]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In Proceedings of the 33rd International Conference on Machine Learning. 2071--2080.
[30]
Denny Vrandei and Markus Krtzsch. 2014. Wikidata: A free collaborative knowledge base. Commun. ACM, Vol. 57 (2014), 78--85.
[31]
Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. 2017. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Dada Engineering, Vol. 29, 12 (2017), 2724--2743.
[32]
Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence. 1112--1119.
[33]
Y. Gu X. Lv, X. Han, L. Hou, J. Li, and Z. Liu. 2019. Adapting meta knowledge graph information for multi-hop reasoning over fewshot relations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. 3374--3379.
[34]
Chenyan Xiong, Russell Power, and Jamie Callan. 2017. Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding. In Proceedings of the 26th International Conference on World Wide Web. 1271--1279.
[35]
W. Xiong, M. Yu, S. Chang, X. Guo, and W. Y. Wang. 2018. One-shot relational learning for knowledge graphs. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 1980--1990.
[36]
Chuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang, Zhenhui Li, and Nitesh V. Chawla. 2020. Few-Shot Knowledge Graph Completion. In Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence. 3041--3048.
[37]
Hao Zhou, Tom Young, Minlie Huang, Haizhou Zhao, and Xiaoyan Zhu. 2018. Commonsense Knowledge Aware Conversation Generation with Graph Attention. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. 4623--4629.

Cited By

View all
  • (2025)Multi-hop interpretable meta learning for few-shot temporal knowledge graph completionNeural Networks10.1016/j.neunet.2024.106981183(106981)Online publication date: Mar-2025
  • (2024)Intelligent Numerical Control Programming System Based on Knowledge GraphMachines10.3390/machines1212085112:12(851)Online publication date: 26-Nov-2024
  • (2024)A method integrating enhanced hinge loss function for few-shot knowledge graph completionProceedings of the 3rd International Conference on Computer, Artificial Intelligence and Control Engineering10.1145/3672758.3672845(535-540)Online publication date: 26-Jan-2024
  • Show More Cited By

Index Terms

  1. Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completion

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
      July 2021
      2998 pages
      ISBN:9781450380379
      DOI:10.1145/3404835
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 July 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. few-shot relation
      2. gating mechanism
      3. knowledge graph completion
      4. meta-learning
      5. neighbor information

      Qualifiers

      • Research-article

      Conference

      SIGIR '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 792 of 3,983 submissions, 20%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)131
      • Downloads (Last 6 weeks)11
      Reflects downloads up to 19 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Multi-hop interpretable meta learning for few-shot temporal knowledge graph completionNeural Networks10.1016/j.neunet.2024.106981183(106981)Online publication date: Mar-2025
      • (2024)Intelligent Numerical Control Programming System Based on Knowledge GraphMachines10.3390/machines1212085112:12(851)Online publication date: 26-Nov-2024
      • (2024)A method integrating enhanced hinge loss function for few-shot knowledge graph completionProceedings of the 3rd International Conference on Computer, Artificial Intelligence and Control Engineering10.1145/3672758.3672845(535-540)Online publication date: 26-Jan-2024
      • (2024)Few-shot Learning for Heterogeneous Information NetworksACM Transactions on Information Systems10.1145/364931142:4(1-24)Online publication date: 26-Apr-2024
      • (2024)Learning from Novel Knowledge: Continual Few-shot Knowledge Graph CompletionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679734(1326-1335)Online publication date: 21-Oct-2024
      • (2024)MetaHKG: Meta Hyperbolic Learning for Few-shot Temporal ReasoningProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657711(59-69)Online publication date: 10-Jul-2024
      • (2024)Adaptive Prototype Interaction Network for Few-Shot Knowledge Graph CompletionIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.328354535:11(15237-15250)Online publication date: Nov-2024
      • (2024)HoGRN: Explainable Sparse Knowledge Graph Completion via High-Order Graph Reasoning NetworkIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342222636:12(8462-8475)Online publication date: Dec-2024
      • (2024)Few-Shot Fuzzy Temporal Knowledge Graph Completion via Fuzzy Semantics and Dynamic Attention NetworkIEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2024.344700332:11(6329-6339)Online publication date: Nov-2024
      • (2024)BERT-FKGC: Text-Enhanced Few-Shot Representation Learning for Knowledge Graphs2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10651190(1-8)Online publication date: 30-Jun-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media