Get Rid of Suspended Animation Problem: Deep Diffusive Neural Network on Graph Semi-Supervised Classification

Abstract

Existing graph neural networks may suffer from the "suspended animation problem" when the model architecture goes deep. Meanwhile, for some graph learning scenarios, e.g., nodes with text/image attributes or graphs with long-distance node correlations, deep graph neural networks will be necessary for effective graph representation learning. In this paper, we propose a new graph neural network, namely DIFNET (Graph Diffusive Neural Network), for graph representation learning and node classification. DIFNET utilizes both neural gates and graph residual learning for node hidden state modeling, and includes an attention mechanism for node neighborhood information diffusion. Extensive experiments will be done in this paper to compare DIFNET against several state-of-the-art graph neural network models. The experimental results can illustrate both the learning performance advantages and effectiveness of DIFNET, especially in addressing the "suspended animation problem".

arXiv comment7 pages, 6 figures

References in corpus (9)

• Learning Convolutional Neural Networks for Graphs
• Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search
• GraphNAS: Graph Neural Architecture Search with Reinforcement Learning
• GResNet: Graph Residual Network for Reviving Deep GNNs from Suspended Animation
• Geometric deep learning on graphs and manifolds using mixture model CNNs
• AdaGCN: Adaboosting Graph Convolutional Networks into Deep Models
• Deep Gate Recurrent Neural Network
• Graph Neural Networks for Small Graph and Giant Network Representation Learning: An Overview
• Deep Loopy Neural Network Model for Graph Structured Data Representation Learning

Cited by in corpus (1)

• Multi-hop Graph Convolutional Network with High-order Chebyshev Approximation for Text Reasoning