Graph Convolution with Low-rank Learnable Local Filters

Abstract

Geometric variations like rotation, scaling, and viewpoint changes pose a significant challenge to visual understanding. One common solution is to directly model certain intrinsic structures, e.g., using landmarks. However, it then becomes non-trivial to build effective deep models, especially when the underlying non-Euclidean grid is irregular and coarse. Recent deep models using graph convolutions provide an appropriate framework to handle such non-Euclidean data, but many of them, particularly those based on global graph Laplacians, lack expressiveness to capture local features required for representation of signals lying on the non-Euclidean grid. The current paper introduces a new type of graph convolution with learnable low-rank local filters, which is provably more expressive than previous spectral graph convolution methods. The model also provides a unified framework for both spectral and spatial graph convolutions. To improve model robustness, regularization by local graph Laplacians is introduced. The representation stability against input graph data perturbation is theoretically proved, making use of the graph filter locality and the local graph regularization. Experiments on spherical mesh data, real-world facial expression recognition/skeleton-based action recognition data, and data with simulated graph noise show the empirical advantage of the proposed model.

References in corpus (13)

• Semi-Supervised Classification with Graph Convolutional Networks
• Neural Message Passing for Quantum Chemistry
• Geometric deep learning: going beyond Euclidean data
• The Kinetics Human Action Video Dataset
• Spectral Networks and Locally Connected Networks on Graphs
• GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs
• Stability Properties of Graph Neural Networks
• LanczosNet: Multi-Scale Deep Graph Convolutional Networks
• Universal Invariant and Equivariant Graph Neural Networks
• A Survey on 3D Skeleton-Based Action Recognition Using Learning Method
• Spherical CNNs on Unstructured Grids
• DCFNet: Deep Neural Network with Decomposed Convolutional Filters
• Parallel Transport Convolution: A New Tool for Convolutional Neural Networks on Manifolds