Nonconvex Sorted ${\ell }_1$ Minimization for Sparse Approximation

Abstract

The ${\ell }_1$ norm is the tight convex relaxation for the ${\ell }_0$ "norm" and has been successfully applied for recovering sparse signals. For problems with fewer samplings, one needs to enhance the sparsity by nonconvex penalties such as ${\ell }_p$ "norm". As one method for solving ${\ell }_p$ minimization problems, iteratively reweighted ${\ell }_1$ minimization updates the weight for each component based on the value of the same component at the previous iteration. It assigns large weights on small components in magnitude and small weights on large components in magnitude. In this paper, we consider a weighted ${\ell }_1$ penalty with the set of the weights fixed and the weights are assigned based on the sort of all the components in magnitude. The smallest weight is assigned to the largest component in magnitude. This new penalty is called nonconvex sorted ${\ell }_1$. Then we propose two methods for solving nonconvex sorted ${\ell }_1$ minimization problems: iteratively reweighted ${\ell }_1$ minimization and iterative sorted thresholding, and prove that both methods will converge to a local optimum. We also show that both methods are generalizations of iterative support detection and iterative hard thresholding respectively. The numerical experiments demonstrate the better performance of assigning weights by sort compared to ${\ell }_p$ minimization.

23 pages, 3 figures, 2 tables

References in corpus (1)

• Statistical estimation and testing via the sorted L1 norm

Cited by in corpus (7)

• Nonconvex penalties with analytical solutions for one-bit compressive sensing
• A projected gradient method for $\alpha {\ell }_1-\beta {\ell }_2$ sparsity regularization
• Accelerated Sparse Recovery via Gradient Descent with Nonlinear Conjugate Gradient Momentum
• Fast Signal Recovery from Saturated Measurements by Linear Loss and Nonconvex Penalties
• Fast algorithms for robust principal component analysis with an upper bound on the rank
• Fast L1-L2 minimization via a proximal operator
• Iterative ${\ell }_1$ minimization for non-convex compressed sensing