142 citations · 330 across the 18 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 1 cited
Optimization-Based Separations for Neural Networks
Itay Safran, Jason D. Lee
Depth separation results propose a possible theoretical explanation for the benefits of deep neural networks over shallower architectures, establishing that the former possess supe…
cs.LG2021★ 2 cited
Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems
Itay Safran, Ohad Shamir
Recently, there has been much interest in studying the convergence rates of without-replacement SGD, and proving that it is faster than with-replacement SGD in the worst case. Howe…