Learning Dynamic Routing for Semantic Segmentation

Abstract

Recently, numerous handcrafted and searched networks have been applied for semantic segmentation. However, previous works intend to handle inputs with various scales in pre-defined static architectures, such as FCN, U-Net, and DeepLab series. This paper studies a conceptually new method to alleviate the scale variance in semantic representation, named dynamic routing. The proposed framework generates data-dependent routes, adapting to the scale distribution of each image. To this end, a differentiable gating function, called soft conditional gate, is proposed to select scale transform paths on the fly. In addition, the computational cost can be further reduced in an end-to-end manner by giving budget constraints to the gating function. We further relax the network level routing space to support multi-path propagations and skip-connections in each forward, bringing substantial network capacity. To demonstrate the superiority of the dynamic property, we compare with several static architectures, which can be modeled as special cases in the routing space. Extensive experiments are conducted on Cityscapes and PASCAL VOC 2012 to illustrate the effectiveness of the dynamic framework. Code is available at https://github.com/yanwei-li/DynamicRouting.

Accepted by CVPR 2020 as Oral

References in corpus (11)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• Neural Architecture Search with Reinforcement Learning
• Fully Convolutional Networks for Semantic Segmentation
• DARTS: Differentiable Architecture Search
• DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
• High-Resolution Representations for Labeling Pixels and Regions
• Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
• Single Path One-Shot Neural Architecture Search with Uniform Sampling
• Multi-Scale Dense Networks for Resource Efficient Image Classification
• Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks
• Learnable Tree Filter for Structure-preserving Feature Transform

Cited by in corpus (4)

• Multi-Task Reinforcement Learning with Soft Modularization
• Dynamic Neural Networks: A Survey
• Fully Convolutional Networks for Panoptic Segmentation
• Semantically Meaningful Class Prototype Learning for One-Shot Image Semantic Segmentation