Hyperbolic Graph Attention Network

Abstract

Graph neural network (GNN) has shown superior performance in dealing with graphs, which has attracted considerable research attention recently. However, most of the existing GNN models are primarily designed for graphs in Euclidean spaces. Recent research has proven that the graph data exhibits non-Euclidean latent anatomy. Unfortunately, there was rarely study of GNN in non-Euclidean settings so far. To bridge this gap, in this paper, we study the GNN with attention mechanism in hyperbolic spaces at the first attempt. The research of hyperbolic GNN has some unique challenges: since the hyperbolic spaces are not vector spaces, the vector operations (e.g., vector addition, subtraction, and scalar multiplication) cannot be carried. To tackle this problem, we employ the gyrovector spaces, which provide an elegant algebraic formalism for hyperbolic geometry, to transform the features in a graph; and then we propose the hyperbolic proximity based attention mechanism to aggregate the features. Moreover, as mathematical operations in hyperbolic spaces could be more complicated than those in Euclidean spaces, we further devise a novel acceleration strategy using logarithmic and exponential mappings to improve the efficiency of our proposed model. The comprehensive experimental results on four real-world datasets demonstrate the performance of our proposed hyperbolic graph attention network model, by comparisons with other state-of-the-art baseline methods.

8 pages, 4 figures

References in corpus (9)

• Inductive Representation Learning on Large Graphs
• Geometric deep learning: going beyond Euclidean data
• Hierarchical structure and the prediction of missing links in networks
• Hyperbolic Geometry of Complex Networks
• Popularity versus Similarity in Growing Networks
• Session-based Social Recommendation via Dynamic Graph Attention Networks
• Hyperbolic Graph Neural Networks
• Hyperbolic Entailment Cones for Learning Hierarchical Embeddings
• Constant Curvature Graph Convolutional Networks

Cited by in corpus (5)

• Hyperbolic Deep Neural Networks: A Survey
• A Hyperbolic-to-Hyperbolic Graph Convolutional Network
• Hyperbolic Neural Collaborative Recommender
• Lorentzian Graph Convolutional Networks
• HSR: Hyperbolic Social Recommender