Joint Multi-Scale Tone Mapping and Denoising for HDR Image Enhancement

Abstract

An image processing unit (IPU), or image signal processor (ISP) for high dynamic range (HDR) imaging usually consists of demosaicing, white balancing, lens shading correction, color correction, denoising, and tone-mapping. Besides noise from the imaging sensors, almost every step in the ISP introduces or amplifies noise in different ways, and denoising operators are designed to reduce the noise from these sources. Designed for dynamic range compressing, tone-mapping operators in an ISP can significantly amplify the noise level, especially for images captured in low-light conditions, making denoising very difficult. Therefore, we propose a joint multi-scale denoising and tone-mapping framework that is designed with both operations in mind for HDR images. Our joint network is trained in an end-to-end format that optimizes both operators together, to prevent the tone-mapping operator from overwhelming the denoising operator. Our model outperforms existing HDR denoising and tone-mapping operators both quantitatively and qualitatively on most of our benchmarking datasets.

arXiv comment10 pages, 4 figures, WACVW2022. Codes available at https://github.com/hulitaotom/Joint-Multi-Scale-Tone-Mapping-and-Denoising-for-HDR-Image-Enhancement

References in corpus (6)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Noise2Noise: Learning Image Restoration without Clean Data
• LIDIA: Lightweight Learned Image Denoising with Instance Adaptation
• An Analysis and Implementation of the HDR+ Burst Denoising Method

Cited by in corpus (1)

• Joint tone mapping and denoising of thermal infrared images via multi-scale Retinex and multi-task learning