28 citations · 43 across the 5 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018
Step Size Matters in Deep Learning
Kamil Nar, S. Shankar Sastry
Training a neural network with the gradient descent algorithm gives rise to a discrete-time nonlinear dynamical system. Consequently, behaviors that are typically observed in these…
cs.LG2018★ 1 cited
Residual Networks: Lyapunov Stability and Convex Decomposition
Kamil Nar, Shankar Sastry
While training error of most deep neural networks degrades as the depth of the network increases, residual networks appear to be an exception. We show that the main reason for this…