ELASTIC: Improving CNNs with Dynamic Scaling Policies
arXiv:1812.05262
Abstract
Scale variation has been a challenge from traditional to modern approaches in computer vision. Most solutions to scale issues have a similar theme: a set of intuitive and manually designed policies that are generic and fixed (e.g. SIFT or feature pyramid). We argue that the scaling policy should be learned from data. In this paper, we introduce ELASTIC, a simple, efficient and yet very effective approach to learn a dynamic scale policy from data. We formulate the scaling policy as a non-linear function inside the network's structure that (a) is learned from data, (b) is instance specific, (c) does not add extra computation, and (d) can be applied on any network architecture. We applied ELASTIC to several state-of-the-art network architectures and showed consistent improvement without extra (sometimes even lower) computation on ImageNet classification, MSCOCO multi-label classification, and PASCAL VOC semantic segmentation. Our results show major improvement for images with scale challenges. Our code is available here: https://github.com/allenai/elastic
arXiv commentCVPR 2019 oral, code available https://github.com/allenai/elastic
References in corpus (7)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Rethinking Atrous Convolution for Semantic Image Segmentation
- Neural Architecture Search with Reinforcement Learning
- ParseNet: Looking Wider to See Better
- CondenseNet: An Efficient DenseNet using Learned Group Convolutions
- Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classification
- Learning a Wavelet-like Auto-Encoder to Accelerate Deep Neural Networks