11 citations · 22 across the 7 of their papers we have counts for
4 papers · 1 filter
Faster Non-Convex Federated Learning via Global and Local Momentum
Rudrajit Das, Anish Acharya, Abolfazl Hashemi +3
We propose \texttt{FedGLOMO}, a novel federated learning (FL) algorithm with an iteration complexity of to converge to an -stationary point (i.e., $\math…
On Generalization of Adaptive Methods for Over-parameterized Linear Regression
Vatsal Shah, Soumya Basu, Anastasios Kyrillidis +1
Over-parameterization and adaptive methods have played a crucial role in the success of deep learning in the last decade. The widespread use of over-parameterization has forced us…
Choosing the Sample with Lowest Loss makes SGD Robust
Vatsal Shah, Xiaoxia Wu, Sujay Sanghavi
The presence of outliers can potentially significantly skew the parameters of machine learning models trained via stochastic gradient descent (SGD). In this paper we propose a simp…
Learning a Compressed Sensing Measurement Matrix via Gradient Unrolling
Shanshan Wu, Alexandros G. Dimakis, Sujay Sanghavi +5
Linear encoding of sparse vectors is widely popular, but is commonly data-independent -- missing any possible extra (but a priori unknown) structure beyond sparsity. In this paper…