More Web Proxy on the site http://driver.im/

Article

Translating embeddings for modeling multi-relational data

Authors: Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, Oksana YakhnenkoAuthors Info & Claims

NIPS'13: Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2

Pages 2787 - 2795

Published: 05 December 2013 Publication History

Abstract

We consider the problem of embedding entities and relationships of multi-relational data in low-dimensional vector spaces. Our objective is to propose a canonical model which is easy to train, contains a reduced number of parameters and can scale up to very large databases. Hence, we propose TransE, a method which models relationships by interpreting them as translations operating on the low-dimensional embeddings of the entities. Despite its simplicity, this assumption proves to be powerful since extensive experiments show that TransE significantly outperforms state-of-the-art methods in link prediction on two knowledge bases. Besides, it can be successfully trained on a large scale data set with 1M entities, 25k relationships and more than 17M training samples.

References

[1]

K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor. Freebase: a collaboratively created graph database for structuring human knowledge. In Proceedings of the 2008 ACM SIGMOD international conference on Management of data, 2008.

Digital Library

[2]

A. Bordes, X. Glorot, J. Weston, and Y. Bengio. A semantic matching energy function for learning with multi-relational data. Machine Learning, 2013.

Digital Library

[3]

A. Bordes, J. Weston, R. Collobert, and Y. Bengio. Learning structured embeddings of knowledge bases. In Proceedings of the 25th Annual Conference on Artificial Intelligence (AAAI), 2011.

Digital Library

[4]

X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS)., 2010.

[5]

R. A. Harshman and M. E. Lundy. Parafac: parallel factor analysis. Computational Statistics & Data Analysis, 18(1):39-72, Aug. 1994.

Digital Library

[6]

R. Jenatton, N. Le Roux, A. Bordes, G. Obozinski, et al. A latent factor model for highly multi-relational data. In Advances in Neural Information Processing Systems (NIPS 25), 2012.

[7]

C. Kemp, J. B. Tenenbaum, T. L. Griffiths, T. Yamada, and N. Ueda. Learning systems of concepts with an infinite relational model. In Proceedings of the 21st Annual Conference on Artificial Intelligence (AAAI), 2006.

Digital Library

[8]

T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems (NIPS 26), 2013.

[9]

G. Miller. WordNet: a Lexical Database for English. Communications of the ACM, 38(11):39-41, 1995.

Digital Library

[10]

K. Miller, T. Griffiths, and M. Jordan. Nonparametric latent feature models for link prediction. In Advances in Neural Information Processing Systems (NIPS 22), 2009.

Digital Library

[11]

M. Nickel, V. Tresp, and H.-P. Kriegel. A three-way model for collective learning on multi-relational data. In Proceedings of the 28th International Conference on Machine Learning (ICML), 2011.

[12]

M. Nickel, V. Tresp, and H.-P. Kriegel. Factorizing YAGO: scalable machine learning for linked data. In Proceedings of the 21st international conference on World Wide Web (WWW), 2012.

Digital Library

[13]

A. P. Singh and G. J. Gordon. Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2008.

Digital Library

[14]

R. Socher, D. Chen, C. D. Manning, and A. Y. Ng. Learning new facts from knowledge bases with neural tensor networks and semantic word vectors. In Advances in Neural Information Processing Systems (NIPS 26), 2013.

[15]

I. Sutskever, R. Salakhutdinov, and J. Tenenbaum. Modelling relational data using bayesian clustered tensor factorization. In Advances in Neural Information Processing Systems (NIPS 22), 2009.

Digital Library

[16]

J. Weston, A. Bordes, O. Yakhnenko, and N. Usunier. Connecting language and knowledge bases with embedding models for relation extraction. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2013.

[17]

J. Zhu. Max-margin nonparametric latent feature models for link prediction. In Proceedings of the 29th International Conference on Machine Learning (ICML), 2012.

Cited By

Li RLi CShen YZhang ZChen XSalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Generalizing knowledge graph embedding with universal orthogonal parameterizationProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3693194(28040-28059)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3693194
Hang JHong ZFeng XWang GCao DQiao JWang HZhang D(2024)Complex-Path: Effective and Efficient Node Ranking with Paths in Billion-Scale Heterogeneous GraphsProceedings of the VLDB Endowment10.14778/3685800.368582017:12(3973-3986)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685820
Jannach DZanker M(2024)A Survey on Intent-aware Recommender SystemsACM Transactions on Recommender Systems10.1145/37008903:2(1-32)Online publication date: 23-Dec-2024
https://dl.acm.org/doi/10.1145/3700890
Show More Cited By

Index Terms

Translating embeddings for modeling multi-relational data

Index terms have been assigned to the content through auto-classification.

Recommendations

Translating object-oriented database transactions into relational transactions

In this paper, we present methods of translating transactions from object-oriented database (OODB) to relational database (RDB). The process involves schema mapping in data definition language and transaction translation in data manipulation language. ...
Translating SQL Into Relational Algebra: Optimization, Semantics, and Equivalence of SQL Queries

In this paper, we present a translator from a relevant subset of SQL into relational algebra. The translation is syntax-directed, with translation rules associated with grammar productions; each production corresponds to a particular type of SQL ...
Watermarking relational data: framework, algorithms and analysis

Abstract.We enunciate the need for watermarking database relations to deter data piracy, identify the characteristics of relational data that pose unique challenges for watermarking, and delineate desirable properties of a watermarking system for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

NIPS'13: Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2

December 2013

3236 pages

Publisher

Curran Associates Inc.

Red Hook, NY, United States

Publication History

Published: 05 December 2013

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

512
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li RLi CShen YZhang ZChen XSalakhutdinov RKolter ZHeller KWeller AOliver NScarlett JBerkenkamp F(2024)Generalizing knowledge graph embedding with universal orthogonal parameterizationProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3693194(28040-28059)Online publication date: 21-Jul-2024
https://dl.acm.org/doi/10.5555/3692070.3693194
Hang JHong ZFeng XWang GCao DQiao JWang HZhang D(2024)Complex-Path: Effective and Efficient Node Ranking with Paths in Billion-Scale Heterogeneous GraphsProceedings of the VLDB Endowment10.14778/3685800.368582017:12(3973-3986)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685820
Jannach DZanker M(2024)A Survey on Intent-aware Recommender SystemsACM Transactions on Recommender Systems10.1145/37008903:2(1-32)Online publication date: 23-Dec-2024
https://dl.acm.org/doi/10.1145/3700890
Liu ZFang GWang WLiu Q(2024)Multimodal Sign Language Knowledge Graph and Representation: Text Video KeyFrames and Motion TrajectoriesProceedings of the 6th ACM International Conference on Multimedia in Asia10.1145/3696409.3700208(1-7)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3696409.3700208
Payne LXie M(2024)Log File Anomaly Detection Using Knowledge Graph CompletionProceedings of the 2024 8th International Conference on Deep Learning Technologies10.1145/3695719.3695726(42-48)Online publication date: 15-Jul-2024
https://dl.acm.org/doi/10.1145/3695719.3695726
Meng SZhou JChen XLiu YLu FHuang X(2024)Structure-Information-Based Reasoning over the Knowledge Graph: A Survey of Methods and ApplicationsACM Transactions on Knowledge Discovery from Data10.1145/367114818:8(1-42)Online publication date: 16-Aug-2024
https://dl.acm.org/doi/10.1145/3671148
Yao zYang HChen T(2024)A pruning-based word-centered context fragment extraction method for relation extractionProceedings of the 2024 9th International Conference on Mathematics and Artificial Intelligence10.1145/3670085.3670104(97-104)Online publication date: 10-May-2024
https://dl.acm.org/doi/10.1145/3670085.3670104
Tang XChen LShi HLyu D(2024)DHyper: A Recurrent Dual Hypergraph Neural Network for Event Prediction in Temporal Knowledge GraphsACM Transactions on Information Systems10.1145/365301542:5(1-23)Online publication date: 29-Apr-2024
https://dl.acm.org/doi/10.1145/3653015
Jiang CTan CZhang Z(2024)3VFP: Three-View Feature Propagation Entity AlignmentProceedings of the 2024 16th International Conference on Machine Learning and Computing10.1145/3651671.3651777(347-354)Online publication date: 2-Feb-2024
https://dl.acm.org/doi/10.1145/3651671.3651777
Subagdja BShanthoshigaa DWang ZTan A(2024)Machine Learning for Refining Knowledge Graphs: A SurveyACM Computing Surveys10.1145/364031356:6(1-38)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3640313
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents