CGNet: A Light-weight Context Guided Network for Semantic Segmentation

Abstract

The demand of applying semantic segmentation model on mobile devices has been increasing rapidly. Current state-of-the-art networks have enormous amount of parameters hence unsuitable for mobile devices, while other small memory footprint models follow the spirit of classification network and ignore the inherent characteristic of semantic segmentation. To tackle this problem, we propose a novel Context Guided Network (CGNet), which is a light-weight and efficient network for semantic segmentation. We first propose the Context Guided (CG) block, which learns the joint feature of both local feature and surrounding context, and further improves the joint feature with the global context. Based on the CG block, we develop CGNet which captures contextual information in all stages of the network and is specially tailored for increasing segmentation accuracy. CGNet is also elaborately designed to reduce the number of parameters and save memory footprint. Under an equivalent number of parameters, the proposed CGNet significantly outperforms existing segmentation networks. Extensive experiments on Cityscapes and CamVid datasets verify the effectiveness of the proposed approach. Specifically, without any post-processing and multi-scale testing, the proposed CGNet achieves 64.8% mean IoU on Cityscapes with less than 0.5 M parameters. The source code for the complete system can be found at https://github.com/wutianyiRosun/CGNet.

arXiv commentCode: https://github.com/wutianyiRosun/CGNet

References in corpus (11)

• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Rethinking Atrous Convolution for Semantic Image Segmentation
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• MobileNetV2: Inverted Residuals and Linear Bottlenecks
• ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
• The Cityscapes Dataset for Semantic Urban Scene Understanding
• OCNet: Object Context Network for Scene Parsing
• Searching for Efficient Multi-Scale Architectures for Dense Image Prediction
• Context Encoding for Semantic Segmentation
• Learning a Discriminative Feature Network for Semantic Segmentation
• Tree-structured Kronecker Convolutional Network for Semantic Segmentation

Cited by in corpus (18)

• SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
• Reducing DNN Labelling Cost using Surprise Adequacy: An Industrial Case Study for Autonomous Driving
• MiniSeg: An Extremely Minimum Network for Efficient COVID-19 Segmentation
• Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes
• LEDNet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation
• Feature Pyramid Encoding Network for Real-time Semantic Segmentation
• Highly Efficient Salient Object Detection with 100K Parameters
• Segmenting Transparent Objects in the Wild
• Tree-structured Kronecker Convolutional Network for Semantic Segmentation
• Few-shot Video-to-Video Synthesis
• DS-PASS: Detail-Sensitive Panoramic Annular Semantic Segmentation through SwaftNet for Surrounding Sensing
• LRNNet: A Light-Weighted Network with Efficient Reduced Non-Local Operation for Real-Time Semantic Segmentation
• ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentation
• FDDWNet: A Lightweight Convolutional Neural Network for Real-time Sementic Segmentation
• Predicting Terrain Mechanical Properties in Sight for Planetary Rovers with Semantic Clues
• Consensus Feature Network for Scene Parsing
• ItNet: iterative neural networks with small graphs for accurate, efficient and anytime semantic segmentation
• A De-raining semantic segmentation network for real-time foreground segmentation