Projective Splitting with Forward Steps: Asynchronous and Block-Iterative Operator Splitting
arXiv:1803.07043
Abstract
This work is concerned with the classical problem of finding a zero of a sum of maximal monotone operators. For the projective splitting framework recently proposed by Combettes and Eckstein, we show how to replace the fundamental subproblem calculation using a backward step with one based on two forward steps. The resulting algorithms have the same kind of coordination procedure and can be implemented in the same block-iterative and highly flexible manner, but may perform backward steps on some operators and forward steps on others. Prior algorithms in the projective splitting family have used only backward steps. Forward steps can be used for any Lipschitz-continuous operators provided the stepsize is bounded by the inverse of the Lipschitz constant. If the Lipschitz constant is unknown, a simple backtracking linesearch procedure may be used. For affine operators, the stepsize can be chosen adaptively without knowledge of the Lipschitz constant and without any additional forward steps. We close the paper by empirically studying the performance of several kinds of splitting algorithms on a large-scale rare feature selection problem.
arXiv commentNew numerical experiments on a large-scale rare feature selection problem
References in corpus (6)
- ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates
- A first-order primal-dual algorithm with linesearch
- Rare Feature Selection in High Dimensions
- Convergence Rates for Projective Splitting
- Adaptive Three Operator Splitting
- A new splitting method for solving composite monotone inclusions involving parallel-sum operators
Cited by in corpus (5)
- A Random Block-Coordinate Douglas-Rachford Splitting Method with Low Computational Complexity for Binary Logistic Regression
- Convergence Rates for Projective Splitting
- A Forward-Backward Splitting Method for Monotone Inclusions Without Cocoercivity
- Uniqueness of DRS as the 2 Operator Resolvent-Splitting and Impossibility of 3 Operator Resolvent-Splitting
- Asynchronous Sequential Inertial Iterations for Common Fixed Points Problems with an Application to Linear Systems