Bayes EMbedding (BEM): Refining Representation by Integrating Knowledge Graphs and Behavior-specific Networks

Abstract

Low-dimensional embeddings of knowledge graphs and behavior graphs have proved remarkably powerful in varieties of tasks, from predicting unobserved edges between entities to content recommendation. The two types of graphs can contain distinct and complementary information for the same entities/nodes. However, previous works focus either on knowledge graph embedding or behavior graph embedding while few works consider both in a unified way. Here we present BEM , a Bayesian framework that incorporates the information from knowledge graphs and behavior graphs. To be more specific, BEM takes as prior the pre-trained embeddings from the knowledge graph, and integrates them with the pre-trained embeddings from the behavior graphs via a Bayesian generative model. BEM is able to mutually refine the embeddings from both sides while preserving their own topological structures. To show the superiority of our method, we conduct a range of experiments on three benchmark datasets: node classification, link prediction, triplet classification on two small datasets related to Freebase, and item recommendation on a large-scale e-commerce dataset.

arXiv comment25 pages, 5 figures, 10 tables. CIKM 2019

References in corpus (10)

• Auto-Encoding Variational Bayes
• Distributed Representations of Sentences and Documents
• Learning Combinatorial Optimization Algorithms over Graphs
• Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
• Interaction Networks for Learning about Objects, Relations and Physics
• Graph networks as learnable physics engines for inference and control
• Variational Bayesian Inference with Stochastic Search
• mvn2vec: Preservation and Collaboration in Multi-View Network Embedding
• The Local Rademacher Complexity of Lp-Norm Multiple Kernel Learning
• Knowledge Representation via Joint Learning of Sequential Text and Knowledge Graphs