Big in Japan: Regularizing networks for solving inverse problems

Abstract

Deep learning and (deep) neural networks are emerging tools to address inverse problems and image reconstruction tasks. Despite outstanding performance, the mathematical analysis for solving inverse problems by neural networks is mostly missing. In this paper, we introduce and rigorously analyze families of deep regularizing neural networks (RegNets) of the form $B_{\alpha }+N_{\theta (\alpha )}{B}_{\alpha }$, where $B_{\alpha }$ is a classical regularization and the network $N_{\theta (\alpha )}{B}_{\alpha }$ is trained to recover the missing part ${\mathrm{Id}}_X-B_{\alpha }$ not found by the classical regularization. We show that these regularizing networks yield a convergent regularization method for solving inverse problems. Additionally, we derive convergence rates (quantitative error estimates) assuming a sufficient decay of the associated distance function. We demonstrate that our results recover existing convergence and convergence rates results for filter-based regularization methods as well as the recently introduced null space network as special cases. Numerical results are presented for a tomographic sparse data problem, which clearly demonstrate that the proposed RegNets improve the classical regularization as well as the null space network.

References in corpus (8)

• Solving ill-posed inverse problems using iterative deep neural networks
• CNN-Based Projected Gradient Descent for Consistent Image Reconstruction
• Deep Generative Adversarial Networks for Compressed Sensing Automates MRI
• Learning The Invisible: A Hybrid Deep Learning-Shearlet Framework for Limited Angle Computed Tomography
• Deep Null Space Learning for Inverse Problems: Convergence Analysis and Rates
• Deep Bayesian Inversion
• Recurrent Generative Adversarial Networks for Proximal Learning and Automated Compressive Image Recovery
• Learning to solve inverse problems using Wasserstein loss

Cited by in corpus (3)

• Solving Inverse Problems With Deep Neural Networks -- Robustness Included?
• An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values
• NETT Regularization for Compressed Sensing Photoacoustic Tomography