Collaborative Total Variation: A General Framework for Vectorial TV Models

Abstract

Even after over two decades, the total variation (TV) remains one of the most popular regularizations for image processing problems and has sparked a tremendous amount of research, particularly to move from scalar to vector-valued functions. In this paper, we consider the gradient of a color image as a three dimensional matrix or tensor with dimensions corresponding to the spatial extend, the differences to other pixels, and the spectral channels. The smoothness of this tensor is then measured by taking different norms along the different dimensions. Depending on the type of these norms one obtains very different properties of the regularization, leading to novel models for color images. We call this class of regularizations collaborative total variation (CTV). On the theoretical side, we characterize the dual norm, the subdifferential and the proximal mapping of the proposed regularizers. We further prove, with the help of the generalized concept of singular vectors, that an ${\ell }^{\infty }$ channel coupling makes the most prior assumptions and has the greatest potential to reduce color artifacts. Our practical contributions consist of an extensive experimental section where we compare the performance of a large number of collaborative TV methods for inverse problems like denoising, deblurring and inpainting.

References in corpus (2)

• Adaptive Primal-Dual Hybrid Gradient Methods for Saddle-Point Problems
• Locally Sparse Reconstruction Using the ${\ell }^{1,\infty }$-Norm

Cited by in corpus (13)

• Guaranteed Tensor Recovery Fused Low-rankness and Smoothness
• PDE-based Group Equivariant Convolutional Neural Networks
• Higher-order total variation approaches and generalisations
• Core Imaging Library -- Part II: Multichannel reconstruction for dynamic and spectral tomography
• Dualize, Split, Randomize: Toward Fast Nonsmooth Optimization Algorithms
• Distributed Proximal Splitting Algorithms with Rates and Acceleration
• Joint demosaicing and fusion of multiresolution coded acquisitions: A unified image formation and reconstruction method
• Fenchel Duality Theory and A Primal-Dual Algorithm on Riemannian Manifolds
• First- and Second-Order Analysis for Optimization Problems with Manifold-Valued Constraints
• Convex Regularization of Multi-Channel Images Based on Variants of the TV-Model
• Joint image edge reconstruction and its application in multi-contrast MRI
• How to exploit prior information in low-complexity models
• Learned Spectral Computed Tomography