GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond

Abstract

The Non-Local Network (NLNet) presents a pioneering approach for capturing long-range dependencies, via aggregating query-specific global context to each query position. However, through a rigorous empirical analysis, we have found that the global contexts modeled by non-local network are almost the same for different query positions within an image. In this paper, we take advantage of this finding to create a simplified network based on a query-independent formulation, which maintains the accuracy of NLNet but with significantly less computation. We further observe that this simplified design shares similar structure with Squeeze-Excitation Network (SENet). Hence we unify them into a three-step general framework for global context modeling. Within the general framework, we design a better instantiation, called the global context (GC) block, which is lightweight and can effectively model the global context. The lightweight property allows us to apply it for multiple layers in a backbone network to construct a global context network (GCNet), which generally outperforms both simplified NLNet and SENet on major benchmarks for various recognition tasks. The code and configurations are released at https://github.com/xvjiarui/GCNet.

References in corpus (2)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• The Kinetics Human Action Video Dataset

Cited by in corpus (24)

• Attention Mechanisms in Computer Vision: A Survey
• MMDetection: Open MMLab Detection Toolbox and Benchmark
• You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection
• Polarized Self-Attention: Towards High-quality Pixel-wise Regression
• GA-NET: Global Attention Network for Point Cloud Semantic Segmentation
• Simple and Lightweight Human Pose Estimation
• SA-Net: Shuffle Attention for Deep Convolutional Neural Networks
• Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognition
• Identification of Pediatric Respiratory Diseases Using Fine-grained Diagnosis System
• Group Ensemble: Learning an Ensemble of ConvNets in a single ConvNet
• Disentangled Non-Local Neural Networks
• On the Integration of Self-Attention and Convolution
• SiamMan: Siamese Motion-aware Network for Visual Tracking
• Data Augmentation for Skin Lesion using Self-Attention based Progressive Generative Adversarial Network
• Dual ResGCN for Balanced Scene GraphGeneration
• Channel Equilibrium Networks for Learning Deep Representation
• Neural Architecture Search for Lightweight Non-Local Networks
• NTIRE 2020 Challenge on Image Demoireing: Methods and Results
• Improving Monocular Depth Estimation by Leveraging Structural Awareness and Complementary Datasets
• BA^2M: A Batch Aware Attention Module for Image Classification
• HR-RCNN: Hierarchical Relational Reasoning for Object Detection
• SERank: Optimize Sequencewise Learning to Rank Using Squeeze-and-Excitation Network
• Microscopic fine-grained instance classification through deep attention
• Efficient Modelling Across Time of Human Actions and Interactions