555 citations · 2.5k across the 105 of their papers we have counts for
Showing 2021 · cs.LGShow all
2 papers · 2 filters
cs.LG2021★ 3 cited
Neural Network Weights Do Not Converge to Stationary Points: An Invariant Measure Perspective
Jingzhao Zhang, Haochuan Li, Suvrit Sra +1
This work examines the deep disconnect between existing theoretical analyses of gradient-based algorithms and the practice of training deep neural networks. Specifically, we provid…
cs.LG2021★ 2 cited
Can Single-Shuffle SGD be Better than Reshuffling SGD and GD?
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
We propose matrix norm inequalities that extend the Recht-Ré (2012) conjecture on a noncommutative AM-GM inequality by supplementing it with another inequality that accounts for si…