908 citations · 2.4k across the 149 of their papers we have counts for
3 papers · 1 filter
Distributed Principal Component Analysis with Limited Communication
Foivos Alimisis, Peter Davies, Bart Vandereycken +1
We study efficient distributed algorithms for the fundamental problem of principal component analysis and leading eigenvector computation on the sphere, when the data are randomly…
Communication-Efficient Distributed Optimization with Quantized Preconditioners
Foivos Alimisis, Peter Davies, Dan Alistarh
We investigate fast and communication-efficient algorithms for the classic problem of minimizing a sum of strongly convex and smooth functions that are distributed among differ…
Asynchronous Optimization Methods for Efficient Training of Deep Neural Networks with Guarantees
Vyacheslav Kungurtsev, Malcolm Egan, Bapi Chatterjee +1
Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsm…