Linear Convergence of Stochastic Iterative Greedy Algorithms with Sparse Constraints

Nam Nguyen, Deanna Needell, Tina Woolf

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity…