Graph-guided Architecture Search for Real-time Semantic Segmentation
arXiv:1909.06793
Abstract
Designing a lightweight semantic segmentation network often requires researchers to find a trade-off between performance and speed, which is always empirical due to the limited interpretability of neural networks. In order to release researchers from these tedious mechanical trials, we propose a Graph-guided Architecture Search (GAS) pipeline to automatically search real-time semantic segmentation networks. Unlike previous works that use a simplified search space and stack a repeatable cell to form a network, we introduce a novel search mechanism with new search space where a lightweight model can be effectively explored through the cell-level diversity and latencyoriented constraint. Specifically, to produce the cell-level diversity, the cell-sharing constraint is eliminated through the cell-independent manner. Then a graph convolution network (GCN) is seamlessly integrated as a communication mechanism between cells. Finally, a latency-oriented constraint is endowed into the search process to balance the speed and performance. Extensive experiments on Cityscapes and CamVid datasets demonstrate that GAS achieves the new state-of-the-art trade-off between accuracy and speed. In particular, on Cityscapes dataset, GAS achieves the new best performance of 73.5% mIoU with speed of 108.4 FPS on Titan Xp.
arXiv commentCVPR2020
References in corpus (16)
- Semi-Supervised Classification with Graph Convolutional Networks
- Rethinking Atrous Convolution for Semantic Image Segmentation
- Neural Architecture Search with Reinforcement Learning
- DARTS: Differentiable Architecture Search
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
- SMASH: One-Shot Model Architecture Search through HyperNetworks
- Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
- ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
- Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation
- DeepArchitect: Automatically Designing and Training Deep Architectures
- Progressive Differentiable Architecture Search: Bridging the Depth Gap between Search and Evaluation
- High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks
- ASAP: Architecture Search, Anneal and Prune
- Reinforced Evolutionary Neural Architecture Search
- IRLAS: Inverse Reinforcement Learning for Architecture Search