Learning Filter Bank Sparsifying Transforms

Abstract

Data is said to follow the transform (or analysis) sparsity model if it becomes sparse when acted on by a linear operator called a sparsifying transform. Several algorithms have been designed to learn such a transform directly from data, and data-adaptive sparsifying transforms have demonstrated excellent performance in signal restoration tasks. Sparsifying transforms are typically learned using small sub-regions of data called patches, but these algorithms often ignore redundant information shared between neighboring patches. We show that many existing transform and analysis sparse representations can be viewed as filter banks, thus linking the local properties of patch-based model to the global properties of a convolutional model. We propose a new transform learning framework where the sparsifying transform is an undecimated perfect reconstruction filter bank. Unlike previous transform learning algorithms, the filter length can be chosen independently of the number of filter bank channels. Numerical results indicate filter bank sparsifying transforms outperform existing patch-based transform learning for image denoising while benefiting from additional flexibility in the design process.

References in corpus (11)

• Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
• Convolutional Dictionary Learning: A Comparative Review and New Algorithms
• Analysis Operator Learning and Its Application to Image Reconstruction
• Working Locally Thinking Globally: Theoretical Guarantees for Convolutional Sparse Coding
• Insights into analysis operator learning: From patch-based sparse models to higher-order MRFs
• Constrained Overcomplete Analysis Operator Learning for Cosparse Signal Modelling
• Learning ${\ell }_1$-based analysis and synthesis sparsity priors using bi-level optimization
• Working Locally Thinking Globally - Part II: Stability and Algorithms for Convolutional Sparse Coding
• Bounding Multivariate Trigonometric Polynomials with Applications to Filter Bank Design
• The Power of Complementary Regularizers: Image Recovery via Transform Learning and Low-Rank Modeling
• Generic Feasibility of Perfect Reconstruction with Short FIR Filters in Multi-channel Systems

Cited by in corpus (10)

• Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning
• Transform Learning for Magnetic Resonance Image Reconstruction: From Model-based Learning to Building Neural Networks
• Bilevel methods for image reconstruction
• Unified Supervised-Unsupervised (SUPER) Learning for X-ray CT Image Reconstruction
• Learning Deep Analysis Dictionaries for Image Super-Resolution
• Learned convex regularizers for inverse problems
• Bounding Multivariate Trigonometric Polynomials with Applications to Filter Bank Design
• Learning Deep Analysis Dictionaries -- Part II: Convolutional Dictionaries
• Two-layer Residual Sparsifying Transform Learning for Image Reconstruction
• Wavelet Design in a Learning Framework