DetNAS: Backbone Search for Object Detection
arXiv:1903.10979
Abstract
Object detectors are usually equipped with backbone networks designed for image classification. It might be sub-optimal because of the gap between the tasks of image classification and object detection. In this work, we present DetNAS to use Neural Architecture Search (NAS) for the design of better backbones for object detection. It is non-trivial because detection training typically needs ImageNet pre-training while NAS systems require accuracies on the target detection task as supervisory signals. Based on the technique of one-shot supernet, which contains all possible networks in the search space, we propose a framework for backbone search on object detection. We train the supernet under the typical detector training schedule: ImageNet pre-training and detection fine-tuning. Then, the architecture search is performed on the trained supernet, using the detection task as the guidance. This framework makes NAS on backbones very efficient. In experiments, we show the effectiveness of DetNAS on various detectors, for instance, one-stage RetinaNet and the two-stage FPN. We empirically find that networks searched on object detection shows consistent superiority compared to those searched on ImageNet classification. The resulting architecture achieves superior performance than hand-crafted networks on COCO with much less FLOPs complexity.
In NeurIPS 2019. Code and models are available at https://github.com/megvii-model/DetNAS
References in corpus (11)
- Neural Architecture Search with Reinforcement Learning
- DARTS: Differentiable Architecture Search
- SMASH: One-Shot Model Architecture Search through HyperNetworks
- Random Search and Reproducibility for Neural Architecture Search
- Single Path One-Shot Neural Architecture Search with Uniform Sampling
- Deformable ConvNets v2: More Deformable, Better Results
- Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation
- MetaAnchor: Learning to Detect Objects with Customized Anchors
- Region Proposal by Guided Anchoring
- ThunderNet: Towards Real-time Generic Object Detection
- Differentiable Architecture Search with Ensemble Gumbel-Softmax
Cited by in corpus (41)
- AutoML: A Survey of the State-of-the-Art
- Object Detection in 20 Years: A Survey
- A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
- CBNet: A Composite Backbone Network Architecture for Object Detection
- Evaluating the Search Phase of Neural Architecture Search
- Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications
- Sample and Computation Redistribution for Efficient Face Detection
- DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
- Sample-Efficient Neural Architecture Search by Learning Action Space
- DSNAS: Direct Neural Architecture Search without Parameter Retraining
- How to Train Your Super-Net: An Analysis of Training Heuristics in Weight-Sharing NAS
- NAS-FCOS: Fast Neural Architecture Search for Object Detection
- Manas: Mining Software Repositories to Assist AutoML
- SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection
- Efficient Differentiable Neural Architecture Search with Meta Kernels
- Feature Pyramid Grids
- GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet
- Core-set Sampling for Efficient Neural Architecture Search
- Efficient Deep Neural Networks
- Designing deep neural networks for driver intention recognition
- MnasFPN: Learning Latency-aware Pyramid Architecture for Object Detection on Mobile Devices
- Few-shot Neural Architecture Search
- MTL-NAS: Task-Agnostic Neural Architecture Search towards General-Purpose Multi-Task Learning
- Scale-aware Automatic Augmentation for Object Detection
- PV-NAS: Practical Neural Architecture Search for Video Recognition
- HM-NAS: Efficient Neural Architecture Search via Hierarchical Masking
- AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System
- NAS-Count: Counting-by-Density with Neural Architecture Search
- Towards Oracle Knowledge Distillation with Neural Architecture Search
- Fine-Grained Stochastic Architecture Search
- AutoSTR: Efficient Backbone Search for Scene Text Recognition
- Searching for Stage-wise Neural Graphs In the Limit
- Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation
- Understanding the Effects of Pre-Training for Object Detectors via Eigenspectrum
- Representation Sharing for Fast Object Detector Search and Beyond
- DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
- Single-level Optimization For Differential Architecture Search
- HMCNAS: Neural Architecture Search using Hidden Markov Chains and Bayesian Optimization
- LV-BERT: Exploiting Layer Variety for BERT
- Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation
- Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio