Learning New Facts From Knowledge Bases With Neural Tensor Networks and Semantic Word Vectors

Abstract

Knowledge bases provide applications with the benefit of easily accessible, systematic relational knowledge but often suffer in practice from their incompleteness and lack of knowledge of new entities and relations. Much work has focused on building or extending them by finding patterns in large unannotated text corpora. In contrast, here we mainly aim to complete a knowledge base by predicting additional true relationships between entities, based on generalizations that can be discerned in the given knowledgebase. We introduce a neural tensor network (NTN) model which predicts new relationship entries that can be added to the database. This model can be improved by initializing entity representations with word vectors learned in an unsupervised fashion from text, and when doing this, existing relations can even be queried for entities that were not present in the database. Our model generalizes and outperforms existing models for this problem, and can classify unseen relationships in WordNet with an accuracy of 75.8%.

Cited by in corpus (11)

• Analogical Inference for Multi-Relational Embeddings
• Modeling Relation Paths for Representation Learning of Knowledge Bases
• Deep Learning Approach on Information Diffusion in Heterogeneous Networks
• Cross-lingual Entity Alignment via Joint Attribute-Preserving Embedding
• Can recursive neural tensor networks learn logical reasoning?
• Irreflexive and Hierarchical Relations as Translations
• Learning Distributed Word Representations for Natural Logic Reasoning
• Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputs
• On the Linear Algebraic Structure of Distributed Word Representations
• User Personalized Satisfaction Prediction via Multiple Instance Deep Learning
• Continuous Learning: Engineering Super Features With Feature Algebras