Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks

Abstract

Graph Neural Networks (GNNs) have been widely used for the representation learning of various structured graph data. While promising, most existing GNNs oversimplified the complexity and diversity of the edges in the graph, and thus inefficient to cope with ubiquitous heterogeneous graphs, which are typically in the form of multi-relational graph representations. In this paper, we propose RioGNN, a novel Reinforced, recursive and flexible neighborhood selection guided multi-relational Graph Neural Network architecture, to navigate complexity of neural network structures whilst maintaining relation-dependent representations. We first construct a multi-relational graph, according to the practical task, to reflect the heterogeneity of nodes, edges, attributes and labels. To avoid the embedding over-assimilation among different types of nodes, we employ a label-aware neural similarity measure to ascertain the most similar neighbors based on node attributes. A reinforced relation-aware neighbor selection mechanism is developed to choose the most similar neighbors of a targeting node within a relation before aggregating all neighborhood information from different relations to obtain the eventual node embedding. Particularly, to improve the efficiency of neighbor selecting, we propose a new recursive and scalable reinforcement learning framework with estimable depth and width for different scales of multi-relational graphs. RioGNN can learn more discriminative node embedding with enhanced explainability due to the recognition of individual importance of each relation via the filtering threshold mechanism. Comprehensive experiments on real-world graph data and practical tasks demonstrate the advancements of effectiveness, efficiency and the model explainability, as opposed to other comparative GNN models.

arXiv commentAccepted by ACM TOIS. Code is available at https://github.com/safe-graph/RioGNN

References in corpus (19)

• Continuous control with deep reinforcement learning
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Near linear time algorithm to detect community structures in large-scale networks
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
• Soft Actor-Critic Algorithms and Applications
• Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks
• MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding
• Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsters
• Predicting multicellular function through multi-layer tissue networks
• Adversarial Attack and Defense on Graph Data: A Survey
• Deep Reinforcement Learning meets Graph Neural Networks: exploring a routing optimization use case
• Advanced modularity-specialized label propagation algorithm for detecting communities in networks
• Reinforcement Learning for Relation Classification from Noisy Data
• Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs
• GraphNAS: Graph Neural Architecture Search with Reinforcement Learning
• Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation
• Deep Iterative and Adaptive Learning for Graph Neural Networks
• Neural Similarity Learning

Cited by in corpus (4)

• RoSGAS: Adaptive Social Bot Detection with Reinforced Self-Supervised GNN Architecture Search
• ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network
• Modeling User Behavior With Interaction Networks for Spam Detection
• Pre-training Recommender Systems via Reinforced Attentive Multi-relational Graph Neural Network