Deep Extreme Cut: From Extreme Points to Object Segmentation

Abstract

This paper explores the use of extreme points in an object (left-most, right-most, top, bottom pixels) as input to obtain precise object segmentation for images and videos. We do so by adding an extra channel to the image in the input of a convolutional neural network (CNN), which contains a Gaussian centered in each of the extreme points. The CNN learns to transform this information into a segmentation of an object that matches those extreme points. We demonstrate the usefulness of this approach for guided segmentation (grabcut-style), interactive segmentation, video object segmentation, and dense segmentation annotation. We show that we obtain the most precise results to date, also with less user input, in an extensive and varied selection of benchmarks and datasets. All our models and code are publicly available on http://www.vision.ee.ethz.ch/~cvlsegmentation/dextr/.

arXiv commentCVPR 2018 camera ready. Project webpage and code: http://www.vision.ee.ethz.ch/~cvlsegmentation/dextr/

References in corpus (13)

• Deep Residual Learning for Image Recognition
• Fully Convolutional Networks for Semantic Segmentation
• What makes for effective detection proposals?
• Learning to Segment Object Candidates
• DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
• Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation
• Pyramid Scene Parsing Network
• Fully Convolutional Multi-Class Multiple Instance Learning
• BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation
• Deep Interactive Object Selection
• Training object class detectors with click supervision
• Deep GrabCut for Object Selection
• Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks

Cited by in corpus (7)

• Interactive segmentation of medical images through fully convolutional neural networks
• Detecting Multi-Oriented Text with Corner-based Region Proposals
• Interactive Video Object Segmentation in the Wild
• PolyTransform: Deep Polygon Transformer for Instance Segmentation
• Weakly Labeling the Antarctic: The Penguin Colony Case
• Block Annotation: Better Image Annotation for Semantic Segmentation with Sub-Image Decomposition
• One-Shot Segmentation in Clutter