91 citations · 113 across the 41 of their papers we have counts for
3 papers · 1 filter
Distributed Fixed Point Methods with Compressed Iterates
Sélim Chraibi, Ahmed Khaled, Dmitry Kovalev +3
We propose basic and natural assumptions under which iterative optimization methods with compressed iterates can be analyzed. This problem is motivated by the practice of federated…
Scaling Up Quasi-Newton Algorithms: Communication Efficient Distributed SR1
Majid Jahani, Mohammadreza Nazari, Sergey Rusakov +2
In this paper, we present a scalable distributed implementation of the Sampled Limited-memory Symmetric Rank-1 (S-LSR1) algorithm. First, we show that a naive distributed implement…
Quasi-Newton Methods for Machine Learning: Forget the Past, Just Sample
Albert S. Berahas, Majid Jahani, Peter Richtárik +1
We present two sampled quasi-Newton methods (sampled LBFGS and sampled LSR1) for solving empirical risk minimization problems that arise in machine learning. Contrary to the classi…