Res2Net: A New Multi-scale Backbone Architecture
arXiv:1904.01169 · doi:10.1109/TPAMI.2019.2938758
Abstract
Representing features at multiple scales is of great importance for numerous vision tasks. Recent advances in backbone convolutional neural networks (CNNs) continually demonstrate stronger multi-scale representation ability, leading to consistent performance gains on a wide range of applications. However, most existing methods represent the multi-scale features in a layer-wise manner. In this paper, we propose a novel building block for CNNs, namely Res2Net, by constructing hierarchical residual-like connections within one single residual block. The Res2Net represents multi-scale features at a granular level and increases the range of receptive fields for each network layer. The proposed Res2Net block can be plugged into the state-of-the-art backbone CNN models, e.g., ResNet, ResNeXt, and DLA. We evaluate the Res2Net block on all these models and demonstrate consistent performance gains over baseline models on widely-used datasets, e.g., CIFAR-100 and ImageNet. Further ablation studies and experimental results on representative computer vision tasks, i.e., object detection, class activation mapping, and salient object detection, further verify the superiority of the Res2Net over the state-of-the-art baseline methods. The source code and trained models are available on https://mmcheng.net/res2net/.
11 pages, 7 figures
References in corpus (18)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Rethinking Atrous Convolution for Semantic Image Segmentation
- Two-Stream Convolutional Networks for Action Recognition in Videos
- Fully Convolutional Networks for Semantic Segmentation
- Squeeze-and-Excitation Networks
- How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)
- Salient Object Detection: A Benchmark
- A Survey of Model Compression and Acceleration for Deep Neural Networks
- Richer Convolutional Features for Edge Detection
- Concealed Object Detection
- Deeply supervised salient object detection with short connections
- High-Resolution Representations for Labeling Pixels and Regions
- Salient Object Detection: A Survey
- Salient Object Detection: A Discriminative Regional Feature Integration Approach
- Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
- Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition
- Dual Path Networks
Cited by in corpus (194)
- Efficient Multi-Scale Attention Module with Cross-Spatial Learning
- ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
- Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
- Concealed Object Detection
- Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
- Towards Large-Scale Small Object Detection: Survey and Benchmarks
- A Review on Deep Learning in UAV Remote Sensing
- JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation
- SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection
- CSPNet: A New Backbone that can Enhance Learning Capability of CNN
- Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
- Boundary-Guided Camouflaged Object Detection
- P2T: Pyramid Pooling Transformer for Scene Understanding
- EDN: Salient Object Detection via Extremely-Downsampled Network
- Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes
- Delving Deep into Label Smoothing
- Feature Aggregation and Propagation Network for Camouflaged Object Detection
- Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Network
- CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection
- YOLO-MS: Rethinking Multi-Scale Representation Learning for Real-time Object Detection
- Deep Hough Transform for Semantic Line Detection
- Bilateral Attention Network for RGB-D Salient Object Detection
- Natural Adversarial Examples
- Spatial Group-wise Enhance: Improving Semantic Feature Learning in Convolutional Networks
- Video Polyp Segmentation: A Deep Learning Perspective
- CBNet: A Composite Backbone Network Architecture for Object Detection
- MobileSal: Extremely Efficient RGB-D Salient Object Detection
- Probabilistic two-stage detection
- Dynamic Feature Integration for Simultaneous Detection of Salient Object, Edge and Skeleton
- Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation
- HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness
- Re-thinking Co-Salient Object Detection
- CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objects
- Advances in Deep Concealed Scene Understanding
- A New Dataset, Poisson GAN and AquaNet for Underwater Object Grabbing
- ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks
- PraNet: Parallel Reverse Attention Network for Polyp Segmentation
- Depth Quality Aware Salient Object Detection
- MFSNet: A Multi Focus Segmentation Network for Skin Lesion Segmentation
- ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detection
- Motion-driven Visual Tempo Learning for Video-based Action Recognition
- ECAPA-TDNN Embeddings for Speaker Diarization
- Large-scale Unsupervised Semantic Segmentation
- A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation
- RNGDet: Road Network Graph Detection by Transformer in Aerial Images
- Building Extraction from Remote Sensing Images via an Uncertainty-Aware Network
- SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Weights Flipping
- VoxSRC 2020: The Second VoxCeleb Speaker Recognition Challenge
- Integrating Frequency Translational Invariance in TDNNs and Frequency Positional Information in 2D ResNets to Enhance Speaker Verification
- VST++: Efficient and Stronger Visual Saliency Transformer
- The IDLAB VoxSRC-20 Submission: Large Margin Fine-Tuning and Quality-Aware Score Calibration in DNN Based Speaker Verification
- Multiscale Vision Transformers
- Salient Objects in Clutter
- Panoptic Segmentation Meets Remote Sensing
- Computer Vision on X-ray Data in Industrial Production and Security Applications: A Comprehensive Survey
- Enhancing Object Detection for Autonomous Driving by Optimizing Anchor Generation and Addressing Class Imbalance
- Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey
- Salient Object Detection via Dynamic Scale Routing
- TEA: Temporal Excitation and Aggregation for Action Recognition
- Depth Awakens: A Depth-perceptual Attention Fusion Network for RGB-D Camouflaged Object Detection
- Learning Delicate Local Representations for Multi-Person Pose Estimation
- PSLT: A Light-weight Vision Transformer with Ladder Self-Attention and Progressive Shift
- VarifocalNet: An IoU-aware Dense Object Detector
- Long-Range Feature Propagating for Natural Image Matting
- Joint Learning of Salient Object Detection, Depth Estimation and Contour Extraction
- Scaling Wide Residual Networks for Panoptic Segmentation
- RefineDetLite: A Lightweight One-stage Object Detection Framework for CPU-only Devices
- Group Communication with Context Codec for Lightweight Source Separation
- Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation
- Siamese Network for RGB-D Salient Object Detection and Beyond
- Generalized Focal Loss V2: Learning Reliable Localization Quality Estimation for Dense Object Detection
- Edge-aware Feature Aggregation Network for Polyp Segmentation
- Medical Image Segmentation Using Squeeze-and-Expansion Transformers
- Rebalanced Zero-shot Learning
- NeXt-TDNN: Modernizing Multi-Scale Temporal Convolution Backbone for Speaker Verification
- Large-Field Contextual Feature Learning for Glass Detection
- The VoxCeleb Speaker Recognition Challenge: A Retrospective
- EfficientTDNN: Efficient Architecture Search for Speaker Recognition
- Low-Resolution Self-Attention for Semantic Segmentation
- The Influence of Dataset Partitioning on Dysfluency Detection Systems
- Feature Pyramid Encoding Network for Real-time Semantic Segmentation
- Cross-Lingual Speaker Verification with Domain-Balanced Hard Prototype Mining and Language-Dependent Score Normalization
- Non-Contrastive Self-supervised Learning for Utterance-Level Information Extraction from Speech
- DNA: Deeply-supervised Nonlinear Aggregation for Salient Object Detection
- Replay and Synthetic Speech Detection with Res2net Architecture
- Disentangled High Quality Salient Object Detection
- Few-Shot Speaker Identification Using Lightweight Prototypical Network with Feature Grouping and Interaction
- Uncertainty Guided Refinement for Fine-Grained Salient Object Detection
- ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object Detection
- Spatial Reconstructed Local Attention Res2Net with F0 Subband for Fake Speech Detection
- WRICNet:A Weighted Rich-scale Inception Coder Network for Multi-Resolution Remote Sensing Image Change Detection
- Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Images
- Trichomonas Vaginalis Segmentation in Microscope Images
- The IDLAB VoxCeleb Speaker Recognition Challenge 2020 System Description
- Learning to Restore a Single Face Image Degraded by Atmospheric Turbulence using CNNs
- Deep Optics for Video Snapshot Compressive Imaging
- BI-GCN: Boundary-Aware Input-Dependent Graph Convolution Network for Biomedical Image Segmentation
- Efficient Differentiable Neural Architecture Search with Meta Kernels
- FocusNet: Classifying Better by Focusing on Confusing Classes
- USAT: A Universal Speaker-Adaptive Text-to-Speech Approach
- Gated Convolutional Networks with Hybrid Connectivity for Image Classification
- ResNeXt and Res2Net Structures for Speaker Verification
- Dynamic Feature Regularized Loss for Weakly Supervised Semantic Segmentation
- A Competitive Method to VIPriors Object Detection Challenge
- YOLO-FEDER FusionNet: A Novel Deep Learning Architecture for Drone Detection
- Highly Efficient Salient Object Detection with 100K Parameters
- Optimizing the F-measure for Threshold-free Salient Object Detection
- The JHU submission to VoxSRC-21: Track 3
- ACFD: Asymmetric Cartoon Face Detector
- Building Computationally Efficient and Well-Generalizing Person Re-Identification Models with Metric Learning
- ACTION-Net: Multipath Excitation for Action Recognition
- CORSAIR: Convolutional Object Retrieval and Symmetry-AIded Registration
- AGE Challenge: Angle Closure Glaucoma Evaluation in Anterior Segment Optical Coherence Tomography
- Shallow Attention Network for Polyp Segmentation
- Training speaker recognition systems with limited data
- The xx205 System for the VoxCeleb Speaker Recognition Challenge 2020
- 1st Place Solutions of Waymo Open Dataset Challenge 2020 -- 2D Object Detection Track
- Interactive Knowledge Distillation
- AISPEECH-SJTU accent identification system for the Accented English Speech Recognition Challenge
- Importance Sampling CAMs for Weakly-Supervised Segmentation
- ContourletNet: A Generalized Rain Removal Architecture Using Multi-Direction Hierarchical Representation
- DW-GAN: A Discrete Wavelet Transform GAN for NonHomogeneous Dehazing
- Localization Distillation for Dense Object Detection
- Densely connected multidilated convolutional networks for dense prediction tasks
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
- ENet: An Edge Enhanced Network for Accurate Liver and Tumor Segmentation on CT Scans
- The 1st Tiny Object Detection Challenge:Methods and Results
- Frontiers in Intelligent Colonoscopy
- MUXConv: Information Multiplexing in Convolutional Neural Networks
- DOTS: Decoupling Operation and Topology in Differentiable Architecture Search
- Semi-Supervised Image Deraining using Gaussian Processes
- Beijing ZKJ-NPU Speaker Verification System for VoxCeleb Speaker Recognition Challenge 2021
- A Two-branch Neural Network for Non-homogeneous Dehazing via Ensemble Learning
- OPANAS: One-Shot Path Aggregation Network Architecture Search for Object Detection
- UDC 2020 Challenge on Image Restoration of Under-Display Camera: Methods and Results
- Topo-boundary: A Benchmark Dataset on Topological Road-boundary Detection Using Aerial Images for Autonomous Driving
- S3Net: A Single Stream Structure for Depth Guided Image Relighting
- M2Former: Multi-Scale Patch Selection for Fine-Grained Visual Recognition
- Two-Stage Adaptive Network for Semi-Supervised Cross-Domain Crater Detection under Varying Scenario Distributions
- When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks
- Syn2Real Transfer Learning for Image Deraining using Gaussian Processes
- Semi-Supervised Recognition under a Noisy and Fine-grained Dataset
- Identifying and Mitigating Machine Learning Biases for the Gravitational Wave Detection Problem
- An Efficient Deep Learning-Based Approach to Automating Invoice Document Validation
- Weakly Supervised Camouflaged Object Detection Based on the SAM Model and Mask Guidance
- An Effective Deep Network for Head Pose Estimation without Keypoints
- RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images
- Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Era
- RMAFF-PSN: A Residual Multi-Scale Attention Feature Fusion Photometric Stereo Network
- Snapshot Interferometric 3D Imaging by Compressive Sensing and Deep Learning
- GMM-ResNext: Combining Generative and Discriminative Models for Speaker Verification
- Improved Res2Net model for Person re-identification
- Split to Be Slim: An Overlooked Redundancy in Vanilla Convolution
- Evaluating Transformers for Lightweight Action Recognition
- Addressing Data Scarcity in Multimodal User State Recognition by Combining Semi-Supervised and Supervised Learning
- The HCCL Speaker Verification System for Far-Field Speaker Verification Challenge
- Disentangle Your Dense Object Detector
- EM-NET: Centerline-Aware Mitochondria Segmentation in EM Images via Hierarchical View-Ensemble Convolutional Network
- LSMVOS: Long-Short-Term Similarity Matching for Video Object
- SpeechNAS: Towards Better Trade-off between Latency and Accuracy for Large-Scale Speaker Verification
- Entity Candidate Network for Whole-Aware Named Entity Recognition
- Multi-level Cross-modal Interaction Network for RGB-D Salient Object Detection
- Deep Spectro-temporal Artifacts for Detecting Synthesized Speech
- Text-Aware Adapter for Few-Shot Keyword Spotting
- Network Architecture Search for Face Enhancement
- FSD: Fully-Specialized Detector via Neural Architecture Search
- HIVE-Net: Centerline-Aware HIerarchical View-Ensemble Convolutional Network for Mitochondria Segmentation in EM Images
- Decoupled Dynamic Filter Networks
- LSTA-Net: Long short-term Spatio-Temporal Aggregation Network for Skeleton-based Action Recognition
- TLGAN: document Text Localization using Generative Adversarial Nets
- UNet--: Memory-Efficient and Feature-Enhanced Network Architecture based on U-Net with Reduced Skip-Connections
- Instance Segmentation Challenge Track Technical Report, VIPriors Workshop at ICCV 2021: Task-Specific Copy-Paste Data Augmentation Method for Instance Segmentation
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
- UPI-Net: Semantic Contour Detection in Placental Ultrasound
- Model-Based Single Image Deep Dehazing
- Gated Res2Net for Multivariate Time Series Analysis
- Towards Fine-grained Large Object Segmentation 1st Place Solution to 3D AI Challenge 2020 -- Instance Segmentation Track
- Interpretable Deep Learning for Stock Returns: A Consensus-Bottleneck Asset Pricing Model
- Understanding Human Innate Immune System Dependencies using Graph Neural Networks
- Global2Local: Efficient Structure Search for Video Action Segmentation
- Self-Regulation for Semantic Segmentation
- Mining Domain Knowledge: Improved Framework towards Automatically Standardizing Anatomical Structure Nomenclature in Radiotherapy
- DARNet: Dual-Attention Residual Network for Automatic Diagnosis of COVID-19 via CT Images
- ICDAR 2021 Competition on Scene Video Text Spotting
- Large-scale Gastric Cancer Screening and Localization Using Multi-task Deep Neural Network
- Boosting Network Weight Separability via Feed-Backward Reconstruction
- USB: Universal-Scale Object Detection Benchmark
- Dedge-AGMNet:an effective stereo matching network optimized by depth edge auxiliary task
- Buildings Classification using Very High Resolution Satellite Imagery
- Weakly Supervised Object Localization and Detection: A Survey
- Inclusive Speaker Verification with Adaptive thresholding
- Depth Completion with RGB Prior
- Free Lunch for Co-Saliency Detection: Context Adjustment
- Dynamic Multi-scale Convolution for Dialect Identification