most citedThe Break-Even Point on Optimization Trajectories of Deep Neural Networks

32 citations · 32 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2020★ 32 cited

The Break-Even Point on Optimization Trajectories of Deep Neural Networks

Stanislaw Jastrzebski, Maciej Szymczak, Stanislav Fort +4

The early phase of training of deep neural networks is critical for their final performance. In this work, we study how the hyperparameters of stochastic gradient descent (SGD) use…