87 citations · 137 across the 23 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021
Multilayer Lookahead: a Nested Version of Lookahead
Denys Pushkin, Luis Barba
In recent years, SGD and its variants have become the standard tool to train Deep Neural Networks. In this paper, we focus on the recently proposed variant Lookahead, which improve…
cs.LG2021
Implicit Gradient Alignment in Distributed and Federated Learning
Yatin Dandi, Luis Barba, Martin Jaggi
A major obstacle to achieving global convergence in distributed and federated learning is the misalignment of gradients across clients, or mini-batches due to heterogeneity and sto…