Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks
arXiv:2002.11867
Abstract
Deep learning's success has been widely recognized in a variety of machine learning tasks, including image classification, audio recognition, and natural language processing. As an extension of deep learning beyond these domains, graph neural networks (GNNs) are designed to handle the non-Euclidean graph-structure which is intractable to previous deep learning techniques. Existing GNNs are presented using various techniques, making direct comparison and cross-reference more complex. Although existing studies categorize GNNs into spatial-based and spectral-based techniques, there hasn't been a thorough examination of their relationship. To close this gap, this study presents a single framework that systematically incorporates most GNNs. We organize existing GNNs into spatial and spectral domains, as well as expose the connections within each domain. A review of spectral graph theory and approximation theory builds a strong relationship across the spatial and spectral domains in further investigation.
References in corpus (24)
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains
- Inductive Representation Learning on Large Graphs
- Neural Message Passing for Quantum Chemistry
- Geometric deep learning: going beyond Euclidean data
- The spread of epidemic disease on networks
- Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties
- Graph Neural Networks: A Review of Methods and Applications
- Simplifying Graph Convolutional Networks
- Effective Approaches to Attention-based Neural Machine Translation
- DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
- Diffusion-Convolutional Neural Networks
- Graph Neural Networks with convolutional ARMA filters
- MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing
- PairNorm: Tackling Oversmoothing in GNNs
- A Spectral Graph Uncertainty Principle
- Differentiable Learning of Logical Rules for Knowledge Base Reasoning
- Deep Learning on Graphs: A Survey
- Anti-Money Laundering in Bitcoin: Experimenting with Graph Convolutional Networks for Financial Forensics
- DeepGCNs: Can GCNs Go as Deep as CNNs?
- Explainability Techniques for Graph Convolutional Networks
- What graph neural networks cannot learn: depth vs width
- Beyond Low-frequency Information in Graph Convolutional Networks
- Rational Neural Networks for Approximating Jump Discontinuities of Graph Convolution Operator