Generalized Deep Image to Image Regression
arXiv:1612.03268
Abstract
We present a Deep Convolutional Neural Network architecture which serves as a generic image-to-image regressor that can be trained end-to-end without any further machinery. Our proposed architecture: the Recursively Branched Deconvolutional Network (RBDN) develops a cheap multi-context image representation very early on using an efficient recursive branching scheme with extensive parameter sharing and learnable upsampling. This multi-context representation is subjected to a highly non-linear locality preserving transformation by the remainder of our network comprising of a series of convolutions/deconvolutions without any spatial downsampling. The RBDN architecture is fully convolutional and can handle variable sized images during inference. We provide qualitative/quantitative results on diverse tasks: relighting, denoising and colorization and show that our proposed RBDN architecture obtains comparable results to the state-of-the-art on each of these tasks when used off-the-shelf without any post processing or task-specific architectural modifications.
Submitted to CVPR on November 15th, 2016. Code will be made available soon
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Caffe: Convolutional Architecture for Fast Feature Embedding
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution
- Fully Convolutional Networks for Semantic Segmentation
- Learning Deconvolution Network for Semantic Segmentation
- Learning Structured Sparsity in Deep Neural Networks
- Learning Representations for Automatic Colorization
- On learning optimized reaction diffusion processes for effective image restoration
- Colorful Image Colorization
- Deep End2End Voxel2Voxel Prediction