Deep Feature Consistent Deep Image Transformations: Downscaling, Decolorization and HDR Tone Mapping

Abstract

Building on crucial insights into the determining factors of the visual integrity of an image and the property of deep convolutional neural network (CNN), we have developed the Deep Feature Consistent Deep Image Transformation (DFC-DIT) framework which unifies challenging one-to-many mapping image processing problems such as image downscaling, decolorization (colour to grayscale conversion) and high dynamic range (HDR) image tone mapping. We train one CNN as a non-linear mapper to transform an input image to an output image following what we term the deep feature consistency principle which is enforced through another pretrained and fixed deep CNN. This is the first work that uses deep learning to solve and unify these three common image processing tasks. We present experimental results to demonstrate the effectiveness of the DFC-DIT technique and its state of the art performances.

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Understanding Neural Networks Through Deep Visualization
• Learning Representations for Automatic Colorization
• Deep Feature Consistent Variational Autoencoder

Cited by in corpus (5)

• Deep Tone Mapping Operator for High Dynamic Range Images
• Approaching the Limit of Image Rescaling via Flow Guidance
• A color temperature-based high-speed decolorization: an empirical approach for tone mapping applications
• Learning Deep Image Priors for Blind Image Denoising
• Nonlocal Co-occurrence for Image Downscaling