Exclusive Group Lasso for Structured Variable Selection
arXiv:2108.10284
Abstract
A structured variable selection problem is considered in which the covariates, divided into predefined groups, activate according to sparse patterns with few nonzero entries per group. Capitalizing on the concept of atomic norm, a composite norm can be properly designed to promote such exclusive group sparsity patterns. The resulting norm lends itself to efficient and flexible regularized optimization algorithms for support recovery, like the proximal algorithm. Moreover, an active set algorithm is proposed that builds the solution by successively including structure atoms into the estimated support. It is also shown that such an algorithm can be tailored to match more rigid structures than plain exclusive group sparsity. Asymptotic consistency analysis (with both the number of parameters as well as the number of groups growing with the observation size) establishes the effectiveness of the proposed solution in terms of signed support recovery under conventional assumptions. Finally, a set of numerical simulations further corroborates the results.
arXiv comment36 pages, 2 figures. Not submitted for publication. New license
References in corpus (7)
- Structured Variable Selection with Sparsity-Inducing Norms
- Learning with Structured Sparsity
- Proximal Methods for Hierarchical Sparse Coding
- Compressed Sensing and Parallel Acquisition
- A Penalty Function Promoting Sparsity Within and Across Groups
- Learning the Structure for Structured Sparsity
- A dual Newton based preconditioned proximal point algorithm for exclusive lasso models