Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy
arXiv:2009.06205 · doi:10.1016/j.cam.2023.115330
Abstract
Image demosaicking and denoising are the first two key steps of the color image production pipeline. The classical processing sequence has for a long time consisted of applying denoising first, and then demosaicking. Applying the operations in this order leads to oversmoothing and checkerboard effects. Yet, it was difficult to change this order, because once the image is demosaicked, the statistical properties of the noise are dramatically changed and hard to handle by traditional denoising models. In this paper, we address this problem by a hybrid machine learning method. We invert the traditional color filter array (CFA) processing pipeline by first demosaicking and then denoising. Our demosaicking algorithm, trained on noiseless images, combines a traditional method and a residual convolutional neural network (CNN). This first stage retains all known information, which is the key point to obtain faithful final results. The noisy demosaicked image is then passed through a second CNN restoring a noiseless full-color image. This pipeline order completely avoids checkerboard effects and restores fine image detail. Although CNNs can be trained to solve jointly demosaicking-denoising end-to-end, we find that this two-stage training performs better and is less prone to failure. It is shown experimentally to improve on the state of the art, both quantitatively and in terms of visual quality.
arXiv comment28 pages, 40 figures
References in corpus (7)
- Adam: A Method for Stochastic Optimization
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising
- Iterative Joint Image Demosaicking and Denoising using a Residual Denoising Network
- Learning Deep Convolutional Networks for Demosaicing
- Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images
- Fast, nonlocal and neural: a lightweight high quality solution to image denoising