Basis Prediction Networks for Effective Burst Denoising with Large Kernels

Abstract

Bursts of images exhibit significant self-similarity across both time and space. This motivates a representation of the kernels as linear combinations of a small set of basis elements. To this end, we introduce a novel basis prediction network that, given an input burst, predicts a set of global basis kernels -- shared within the image -- and the corresponding mixing coefficients -- which are specific to individual pixels. Compared to state-of-the-art techniques that output a large tensor of per-pixel spatiotemporal kernels, our formulation substantially reduces the dimensionality of the network output. This allows us to effectively exploit comparatively larger denoising kernels, achieving both significant quality improvements (over 1dB PSNR) and faster run-times over state-of-the-art methods.

arXiv commentCVPR 2020. Project website at https://www.cse.wustl.edu/~zhihao.xia/bpn/

References in corpus (5)

• Adam: A Method for Stochastic Optimization
• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks
• Multi-Kernel Prediction Networks for Denoising of Burst Images
• Identifying Recurring Patterns with Deep Neural Networks for Natural Image Denoising

Cited by in corpus (2)

• Deep Learning on Image Denoising: An overview
• Dynamic Low-light Imaging with Quanta Image Sensors