961 citations · 1.4k across the 33 of their papers we have counts for
3 papers · 1 filter
Hemingway: Modeling Distributed Optimization Algorithms
Xinghao Pan, Shivaram Venkataraman, Zizheng Tai +1
Distributed optimization algorithms are widely used in many industrial machine learning applications. However choosing the appropriate algorithm and cluster size is often difficult…
Occupy the Cloud: Distributed Computing for the 99%
Eric Jonas, Qifan Pu, Shivaram Venkataraman +2
Distributed computing remains inaccessible to a large number of users, in spite of many open source platforms and extensive commercial offerings. While distributed computation fram…
Breaking Locality Accelerates Block Gauss-Seidel
Stephen Tu, Shivaram Venkataraman, Ashia C. Wilson +3
Recent work by Nesterov and Stich showed that momentum can be used to accelerate the rate of convergence for block Gauss-Seidel in the setting where a fixed partitioning of the coo…