Dual Path Networks
arXiv:1707.01629
Abstract
In this work, we present a simple, highly efficient and modularized Dual Path Network (DPN) for image classification which presents a new topology of connection paths internally. By revealing the equivalence of the state-of-the-art Residual Network (ResNet) and Densely Convolutional Network (DenseNet) within the HORNN framework, we find that ResNet enables feature re-usage while DenseNet enables new features exploration which are both important for learning good representations. To enjoy the benefits from both path topologies, our proposed Dual Path Network shares common features while maintaining the flexibility to explore new features through dual path architectures. Extensive experiments on three benchmark datasets, ImagNet-1k, Places365 and PASCAL VOC, clearly demonstrate superior performance of the proposed DPN over state-of-the-arts. In particular, on the ImagNet-1k dataset, a shallow DPN surpasses the best ResNeXt-101(64x4d) with 26% smaller model size, 25% less computational cost and 8% lower memory consumption, and a deeper DPN (DPN-131) further pushes the state-of-the-art single model performance with about 2 times faster training speed. Experiments on the Places365 large-scale scene dataset, PASCAL VOC detection dataset, and PASCAL VOC segmentation dataset also demonstrate its consistently better performance than DenseNet, ResNet and the latest ResNeXt model over various applications.
for code and models, see https://github.com/cypw/DPNs
Cited by in corpus (87)
- Res2Net: A New Multi-scale Backbone Architecture
- Deep Learning for Single Image Super-Resolution: A Brief Review
- Recent advances and clinical applications of deep learning in medical image analysis
- Benchmark Analysis of Representative Deep Neural Network Architectures
- Path Aggregation Network for Instance Segmentation
- Hello Edge: Keyword Spotting on Microcontrollers
- Deep Learning for Generic Object Detection: A Survey
- Contextual Encoder-Decoder Network for Visual Saliency Prediction
- Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
- Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss
- ESRGAN+ : Further Improving Enhanced Super-Resolution Generative Adversarial Network
- A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
- Natural Adversarial Examples
- Progressive Neural Architecture Search
- Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
- CornerNet: Detecting Objects as Paired Keypoints
- How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNN
- Deep Learning for Automatic Pneumonia Detection
- MgNet: A Unified Framework of Multigrid and Convolutional Neural Network
- Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
- CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
- Shape and Margin-Aware Lung Nodule Classification in Low-dose CT Images via Soft Activation Mapping
- Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition
- Adversarial Complementary Learning for Weakly Supervised Object Localization
- Skin Lesion Diagnosis using Ensembles, Unscaled Multi-Crop Evaluation and Loss Weighting
- Training LSTM Networks with Resistive Cross-Point Devices
- Integrated Object Detection and Tracking with Tracklet-Conditioned Detection
- Competitive Inner-Imaging Squeeze and Excitation for Residual Network
- Learning Delicate Local Representations for Multi-Person Pose Estimation
- Contrastive Self-supervised Neural Architecture Search
- General audio tagging with ensembling convolutional neural network and statistical features
- CFENet: An Accurate and Efficient Single-Shot Object Detector for Autonomous Driving
- A Non-Technical Survey on Deep Convolutional Neural Network Architectures
- Recent Advances in Deep Learning for Object Detection
- Towards Real-World Blind Face Restoration with Generative Facial Prior
- AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks
- Image Super-Resolution via Dual-State Recurrent Networks
- Channel-wise and Spatial Feature Modulation Network for Single Image Super-Resolution
- BlockQNN: Efficient Block-wise Neural Network Architecture Generation
- ResNet or DenseNet? Introducing Dense Shortcuts to ResNet
- Dense Label Encoding for Boundary Discontinuity Free Rotation Detection
- Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions
- Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition
- Graph-Based Global Reasoning Networks
- BitPruning: Learning Bitlengths for Aggressive and Accurate Quantization
- Rethinking Bottleneck Structure for Efficient Mobile Network Design
- A Coarse-to-Fine Multi-stream Hybrid Deraining Network for Single Image Deraining
- Efficient 3D Fully Convolutional Networks for Pulmonary Lobe Segmentation in CT Images
- An Analysis of Scale Invariance in Object Detection - SNIP
- Gated Convolutional Networks with Hybrid Connectivity for Image Classification
- Multi-Fiber Networks for Video Recognition
- Bag of Tricks for Adversarial Training
- Self-produced Guidance for Weakly-supervised Object Localization
- Online Hyper-parameter Learning for Auto-Augmentation Strategy
- Accelerating Deep Neural Networks with Spatial Bottleneck Modules
- ACNN: a Full Resolution DCNN for Medical Image Segmentation
- Fast Object Detection in Compressed Video
- Densely connected multidilated convolutional networks for dense prediction tasks
- Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action Recognition
- AOGNets: Compositional Grammatical Architectures for Deep Learning
- Parallel Grid Pooling for Data Augmentation
- Sparsely Aggregated Convolutional Networks
- No One Representation to Rule Them All: Overlapping Features of Training Methods
- Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error
- Comprehensive Comparison of Deep Learning Models for Lung and COVID-19 Lesion Segmentation in CT scans
- FlatteNet: A Simple Versatile Framework for Dense Pixelwise Prediction
- Learning to Segment Human Body Parts with Synthetically Trained Deep Convolutional Networks
- WSNet: Compact and Efficient Networks Through Weight Sampling
- Learning from Large-scale Noisy Web Data with Ubiquitous Reweighting for Image Classification
- Bilateral Asymmetry Guided Counterfactual Generating Network for Mammogram Classification
- Classification of simulated radio signals using Wide Residual Networks for use in the search for extra-terrestrial intelligence
- Non-Parametric Transformation Networks
- Gradually Updated Neural Networks for Large-Scale Image Recognition
- A Single-shot Object Detector with Feature Aggragation and Enhancement
- RecNets: Channel-wise Recurrent Convolutional Neural Networks
- NavigationNet: A Large-scale Interactive Indoor Navigation Dataset
- RoBIC: A benchmark suite for assessing classifiers robustness
- Large e-retailer image dataset for visual search and product classification
- An Approximation Algorithm for Optimal Subarchitecture Extraction
- FCN: Fully Channel-Concatenated Network for Single Image Super-Resolution
- D-PCN: Parallel Convolutional Networks for Image Recognition via a Discriminator
- Adaptive Perturbation for Adversarial Attack
- Sequentially Aggregated Convolutional Networks
- Multi-function Convolutional Neural Networks for Improving Image Classification Performance
- Competing Ratio Loss for Discriminative Multi-class Image Classification
- Multi-Scale Spatially-Asymmetric Recalibration for Image Classification
- Collaborative Annotation of Semantic Objects in Images with Multi-granularity Supervisions