Hierarchical Opacity Propagation for Image Matting
arXiv:2004.03249
Abstract
Natural image matting is a fundamental problem in computational photography and computer vision. Deep neural networks have seen the surge of successful methods in natural image matting in recent years. In contrast to traditional propagation-based matting methods, some top-tier deep image matting approaches tend to perform propagation in the neural network implicitly. A novel structure for more direct alpha matte propagation between pixels is in demand. To this end, this paper presents a hierarchical opacity propagation (HOP) matting method, where the opacity information is propagated in the neighborhood of each point at different semantic levels. The hierarchical structure is based on one global and multiple local propagation blocks. With the HOP structure, every feature point pair in high-resolution feature maps will be connected based on the appearance of input image. We further propose a scale-insensitive positional encoding tailored for image matting to deal with the unfixed size of input image and introduce the random interpolation augmentation into image matting. Extensive experiments and ablation study show that HOP matting is capable of outperforming state-of-the-art matting methods.
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- Semi-Supervised Classification with Graph Convolutional Networks
- Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
- Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
- Spectral Normalization for Generative Adversarial Networks
- Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
- SGDR: Stochastic Gradient Descent with Warm Restarts
- A Structured Self-attentive Sentence Embedding
- Generating Long Sequences with Sparse Transformers
- Stand-Alone Self-Attention in Vision Models
- Interlaced Sparse Self-Attention for Semantic Segmentation
- Natural Image Matting via Guided Contextual Attention