Noah Golowich

activity

20172026

most citedA Convergence Analysis of Gradient Descent for Deep Linear Neural Networks

104 citations · 270 across the 46 of their papers we have counts for

collaborators

Showing 2018Show all

3 papers · 1 filter

cs.LG2018★ 104 cited

A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks

Sanjeev Arora, Nadav Cohen, Noah Golowich +1

We analyze speed of convergence to global optimum for gradient descent training a deep linear neural network (parameterized as $x \mapsto W_{N} W_{N - 1} \dots W_{1} x$ ) by minimizing t…

cs.IT2018

Communication-Rounds Tradeoffs for Common Randomness and Secret Key Generation

Mitali Bafna, Badih Ghazi, Noah Golowich +1

We study the role of interaction in the Common Randomness Generation (CRG) and Secret Key Generation (SKG) problems. In the CRG problem, two players, Alice and Bob, respectively ge…

cs.LG2018★ 44 cited

Theory of Deep Learning IIb: Optimization Properties of SGD

Chiyuan Zhang, Qianli Liao, Alexander Rakhlin +3

In Theory IIb we characterize with a mix of theory and experiments the optimization of deep convolutional networks by Stochastic Gradient Descent. The main new result in this paper…