AASeg: Attention Aware Network for Real Time Semantic Segmentation

Abstract

Semantic segmentation is a fundamental task in computer vision that involves dense pixel-wise classification for scene understanding. Despite significant progress, achieving high accuracy while maintaining real-time performance remains a challenging trade-off, particularly for deployment in resource-constrained or latency-sensitive applications. In this paper, we propose AASeg, a novel Attention-Aware Network for real-time semantic segmentation. AASeg effectively captures both spatial and channel-wise dependencies through lightweight Spatial Attention (SA) and Channel Attention (CA) modules, enabling enhanced feature discrimination without incurring significant computational overhead. To enrich contextual representation, we introduce a Multi-Scale Context (MSC) module that aggregates dense local features across multiple receptive fields. The outputs from attention and context modules are adaptively fused to produce high-resolution segmentation maps. Extensive experiments on Cityscapes, ADE20K, and CamVid demonstrate that AASeg achieves a compelling trade-off between accuracy and efficiency, outperforming prior real-time methods.

References in corpus (6)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• Fast-SCNN: Fast Semantic Segmentation Network
• An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery
• FasterSeg: Searching for Faster Real-time Semantic Segmentation
• Attention-guided Chained Context Aggregation for Semantic Segmentation
• DCANet: Dense Context-Aware Network for Semantic Segmentation