activity
20182021
most citedAre Transformers universal approximators of sequence-to-sequence functions?

44 citations · 82 across the 5 of their papers we have counts for

collaborators
Showing math.OCShow all

2 papers · 1 filter

math.OC2020★ 11 cited

SGD with shuffling: optimal rates without component convexity and large epoch requirements

Kwangjun Ahn, Chulhee Yun, Suvrit Sra

We study without-replacement SGD for solving finite-sum optimization problems. Specifically, depending on how the indices of the finite-sum are shuffled, we consider the RandomShuf…

math.OC2018

Efficiently testing local optimality and escaping saddles for ReLU networks

Chulhee Yun, Suvrit Sra, Ali Jadbabaie

We provide a theoretical algorithm for checking local optimality and escaping saddles at nondifferentiable points of empirical risks of two-layer ReLU networks. Our algorithm recei…