An Online Parallel and Distributed Algorithm for Recursive Estimation of Sparse Signals
arXiv:1503.03773 · doi:10.1109/TSIPN.2016.2561703
Abstract
In this paper, we consider a recursive estimation problem for linear regression where the signal to be estimated admits a sparse representation and measurement samples are only sequentially available. We propose a convergent parallel estimation scheme that consists in solving a sequence of -regularized least-square problems approximately. The proposed scheme is novel in three aspects: i) all elements of the unknown vector variable are updated in parallel at each time instance, and convergence speed is much faster than state-of-the-art schemes which update the elements sequentially; ii) both the update direction and stepsize of each element have simple closed-form expressions, so the algorithm is suitable for online (real-time) implementation; and iii) the stepsize is designed to accelerate the convergence but it does not suffer from the common trouble of parameter tuning in literature. Both centralized and distributed implementation schemes are discussed. The attractive features of the proposed algorithm are also numerically consolidated.
arXiv commentPart of this work has been presented at The Asilomar Conference on Signals, Systems, and Computers, Nov. 2014
References in corpus (10)
- Dynamic Resource Allocation in Cognitive Radio Networks: A Convex Optimization Perspective
- Decomposition by Partial Linearization: Parallel Optimization of Multi-Agent Systems
- Sparse Distributed Learning Based on Diffusion Adaptation
- Parallel Selective Algorithms for Big Data Optimization
- Online Sparse System Identification and Signal Reconstruction using Projections onto Weighted Balls
- Distributed Recursive Least-Squares: Stability and Performance Analysis
- A Parallel Stochastic Approximation Method for Nonconvex Multi-Agent Optimization Problems
- A Sparsity-Aware Adaptive Algorithm for Distributed Learning
- Recursive Group lasso
- Diffusion Adaptation Strategies for Distributed Estimation over Gaussian Markov Random Fields