DeepFlux for Skeletons in the Wild
arXiv:1811.12608
Abstract
Computing object skeletons in natural images is challenging, owing to large variations in object appearance and scale, and the complexity of handling background clutter. Many recent methods frame object skeleton detection as a binary pixel classification problem, which is similar in spirit to learning-based edge detection, as well as to semantic segmentation methods. In the present article, we depart from this strategy by training a CNN to predict a two-dimensional vector field, which maps each scene point to a candidate skeleton pixel, in the spirit of flux-based skeletonization algorithms. This "image context flux" representation has two major advantages over previous approaches. First, it explicitly encodes the relative position of skeletal pixels to semantically meaningful entities, such as the image points in their spatial context, and hence also the implied object boundaries. Second, since the skeleton detection context is a region-based vector field, it is better able to cope with object parts of large width. We evaluate the proposed method on three benchmark datasets for skeleton detection and two for symmetry detection, achieving consistently superior performance over state-of-the-art methods.
arXiv comment10 pages
References in corpus (10)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Caffe: Convolutional Architecture for Fast Feature Embedding
- Microsoft COCO Captions: Data Collection and Evaluation Server
- Fully Convolutional Networks for Semantic Segmentation
- Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
- Richer Convolutional Features for Edge Detection
- Convolutional Pose Machines
- DeepSkeleton: Learning Multi-task Scale-associated Deep Side Outputs for Object Skeleton Extraction in Natural Images
- Deep Watershed Transform for Instance Segmentation
- SRN: Side-output Residual Network for Object Symmetry Detection in the Wild