Human-Aware Motion Deblurring
arXiv:2001.06816
Abstract
This paper proposes a human-aware deblurring model that disentangles the motion blur between foreground (FG) humans and background (BG). The proposed model is based on a triple-branch encoder-decoder architecture. The first two branches are learned for sharpening FG humans and BG details, respectively; while the third one produces global, harmonious results by comprehensively fusing multi-scale deblurring information from the two domains. The proposed model is further endowed with a supervised, human-aware attention mechanism in an end-to-end fashion. It learns a soft mask that encodes FG human information and explicitly drives the FG/BG decoder-branches to focus on their specific domains. To further benefit the research towards Human-aware Image Deblurring, we introduce a large-scale dataset, named HIDE, which consists of 8,422 blurry and sharp image pairs with 65,784 densely annotated FG human bounding boxes. HIDE is specifically built to span a broad range of scenes, human object sizes, motion patterns, and background complexities. Extensive experiments on public benchmarks and our dataset demonstrate that our model performs favorably against the state-of-the-art motion deblurring methods, especially in capturing semantic details.
ICCV2019 paper. Website: https://github.com/joanshen0508/HA_deblur
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections
- Stacked Attention Networks for Image Question Answering
- External Prior Guided Internal Prior Learning for Real-World Noisy Image Denoising
- Deep Networks for Image Super-Resolution with Sparse Prior
- Learning a Convolutional Neural Network for Non-uniform Motion Blur Removal
- Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising
- A Trilateral Weighted Sparse Coding Scheme for Real-World Image Denoising
- Towards Real Scene Super-Resolution with Raw Images