Efficiently Embedding Dynamic Knowledge Graphs
arXiv:1910.06708 · doi:10.1016/j.knosys.2022.109124
Abstract
Knowledge graph (KG) embedding encodes the entities and relations from a KG into low-dimensional vector spaces to support various applications such as KG completion, question answering, and recommender systems. In real world, knowledge graphs (KGs) are dynamic and evolve over time with addition or deletion of triples. However, most existing models focus on embedding static KGs while neglecting dynamics. To adapt to the changes in a KG, these models need to be retrained on the whole KG with a high time cost. In this paper, to tackle the aforementioned problem, we propose a new context-aware Dynamic Knowledge Graph Embedding (DKGE) method which supports the embedding learning in an online fashion. DKGE introduces two different representations (i.e., knowledge embedding and contextual element embedding) for each entity and each relation, in the joint modeling of entities and relations as well as their contexts, by employing two attentive graph convolutional networks, a gate strategy, and translation operations. This effectively helps limit the impacts of a KG update in certain regions, not in the entire graph, so that DKGE can rapidly acquire the updated KG embedding by a proposed online learning algorithm. Furthermore, DKGE can also learn KG embedding from scratch. Experiments on the tasks of link prediction and question answering in a dynamic environment demonstrate the effectiveness and efficiency of DKGE.
46 pages
References in corpus (2)
Cited by in corpus (8)
- Representation Learning for Dynamic Graphs: A Survey
- Relphormer: Relational Graph Transformer for Knowledge Graph Representations
- KisanQRS: A Deep Learning-based Automated Query-Response System for Agricultural Decision-Making
- VN Network: Embedding Newly Emerging Entities with Virtual Neighbors
- Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning
- Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs
- Improving Continual Learning of Knowledge Graph Embeddings via Informed Initialization
- Wikidated 1.0: An Evolving Knowledge Graph Dataset of Wikidata's Revision History