Progressive Joint Low-light Enhancement and Noise Removal for Raw Images

Abstract

Low-light imaging on mobile devices is typically challenging due to insufficient incident light coming through the relatively small aperture, resulting in a low signal-to-noise ratio. Most of the previous works on low-light image processing focus either only on a single task such as illumination adjustment, color enhancement, or noise removal; or on a joint illumination adjustment and denoising task that heavily relies on short-long exposure image pairs collected from specific camera models, and thus these approaches are less practical and generalizable in real-world settings where camera-specific joint enhancement and restoration is required. To tackle this problem, in this paper, we propose a low-light image processing framework that performs joint illumination adjustment, color enhancement, and denoising. Considering the difficulty in model-specific data collection and the ultra-high definition of the captured images, we design two branches: a coefficient estimation branch as well as a joint enhancement and denoising branch. The coefficient estimation branch works in a low-resolution space and predicts the coefficients for enhancement via bilateral learning, whereas the joint enhancement and denoising branch works in a full-resolution space and progressively performs joint enhancement and denoising. In contrast to existing methods, our framework does not need to recollect massive data when being adapted to another camera model, which significantly reduces the efforts required to fine-tune our approach for practical usage. Through extensive experiments, we demonstrate its great potential in real-world low-light imaging applications when compared with current state-of-the-art methods.

References in corpus (19)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising
• NIMA: Neural Image Assessment
• Deep Bilateral Learning for Real-Time Image Enhancement
• The relativistic discriminator: a key element missing from standard GAN
• Deep Retinex Decomposition for Low-Light Enhancement
• EnlightenGAN: Deep Light Enhancement without Paired Supervision
• Handheld Mobile Photography in Very Low Light
• High-level numerical simulations of noise in CCD and CMOS photosensors: review and tutorial
• Learning Enriched Features for Real Image Restoration and Enhancement
• Exposure: A White-Box Photo Post-Processing Framework
• Skellam shrinkage: Wavelet-based intensity estimation for inhomogeneous Poisson data
• Self-supervised Low Light Image Enhancement and Denoising
• Progressive Retinex: Mutually Reinforced Illumination-Noise Perception Network for Low Light Image Enhancement
• Contextual colorization and denoising for low-light ultra high resolution sequences
• Low-light Image Restoration with Short- and Long-exposure Raw Pairs
• NODE: Extreme Low Light Raw Image Denoising using a Noise Decomposition Network
• Reconstructing the Noise Manifold for Image Denoising

Cited by in corpus (4)

• LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images
• Brightness Perceiving for Recursive Low-Light Image Enhancement
• ELMformer: Efficient Raw Image Restoration with a Locally Multiplicative Transformer
• Cross-domain Denoising for Low-dose Multi-frame Spiral Computed Tomography