PanoNet: Real-time Panoptic Segmentation through Position-Sensitive Feature Embedding
arXiv:2008.00192
Abstract
We propose a simple, fast, and flexible framework to generate simultaneously semantic and instance masks for panoptic segmentation. Our method, called PanoNet, incorporates a clean and natural structure design that tackles the problem purely as a segmentation task without the time-consuming detection process. We also introduce position-sensitive embedding for instance grouping by accounting for both object's appearance and its spatial location. Overall, PanoNet yields high panoptic quality results of high-resolution Cityscapes images in real-time, significantly faster than all other methods with comparable performance. Our approach well satisfies the practical speed and memory requirement for many applications like autonomous driving and augmented reality.
References in corpus (9)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Rethinking Atrous Convolution for Semantic Image Segmentation
- R-FCN: Object Detection via Region-based Fully Convolutional Networks
- Brain Tumor Segmentation with Deep Neural Networks
- Conditional Random Fields as Recurrent Neural Networks
- Associative Embedding: End-to-End Learning for Joint Detection and Grouping
- Convolutional Feature Masking for Joint Object and Stuff Segmentation
- Semantic Instance Segmentation with a Discriminative Loss Function
- DeeperLab: Single-Shot Image Parser