Graph Neural Networks in Computer Vision -- Architectures, Datasets and Common Approaches
arXiv:2212.10207 · doi:10.1109/IJCNN55064.2022.9892658
Abstract
Graph Neural Networks (GNNs) are a family of graph networks inspired by mechanisms existing between nodes on a graph. In recent years there has been an increased interest in GNN and their derivatives, i.e., Graph Attention Networks (GAT), Graph Convolutional Networks (GCN), and Graph Recurrent Networks (GRN). An increase in their usability in computer vision is also observed. The number of GNN applications in this field continues to expand; it includes video analysis and understanding, action and behavior recognition, computational photography, image and video synthesis from zero or few shots, and many more. This contribution aims to collect papers published about GNN-based approaches towards computer vision. They are described and summarized from three perspectives. Firstly, we investigate the architectures of Graph Neural Networks and their derivatives used in this area to provide accurate and explainable recommendations for the ensuing investigations. As for the other aspect, we also present datasets used in these works. Finally, using graph analysis, we also examine relations between GNN-based studies in computer vision and potential sources of inspiration identified outside of this field.
arXiv comment2022 International Joint Conference on Neural Networks (IJCNN), 2022
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Neural Message Passing for Quantum Chemistry
- Spectral Networks and Locally Connected Networks on Graphs
- Deep Convolutional Networks on Graph-Structured Data
- Semantic Graph Convolutional Networks for 3D Human Pose Regression
- LatentGNN: Learning Efficient Non-local Relations for Visual Recognition
- Residual Attention Graph Convolutional Network for Geometric 3D Scene Classification
- Modeling Edge Features with Deep Bayesian Graph Networks