7 citations · 10 across the 2 of their papers we have counts for
2 papers
cs.LG2021★ 7 cited
On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent
Shahar Azulay, Edward Moroshko, Mor Shpigel Nacson +4
Recent work has highlighted the role of initialization scale in determining the structure of the solutions that gradient methods converge to. In particular, it was shown that large…
cs.DC2020★ 3 cited
Holdout SGD: Byzantine Tolerant Federated Learning
Shahar Azulay, Lior Raz, Amir Globerson +2
This work presents a new distributed Byzantine tolerant federated learning algorithm, HoldOut SGD, for Stochastic Gradient Descent (SGD) optimization. HoldOut SGD uses the well kno…