653 citations · 2.9k across the 53 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2023
Asymptotic Analysis of Deep Residual Networks
Rama Cont, Alain Rossier, Renyuan Xu
We investigate the asymptotic properties of deep Residual networks (ResNets) as the number of layers increases. We first show the existence of scaling regimes for trained weights m…
cs.LG2022
Convergence and Implicit Regularization Properties of Gradient Descent for Deep Residual Networks
Rama Cont, Alain Rossier, RenYuan Xu
We prove linear convergence of gradient descent to a global optimum for the training of deep residual networks with constant layer width and smooth activation function. We show tha…
cs.LG2021★ 3 cited
Scaling Properties of Deep Residual Networks
Alain-Sam Cohen, Rama Cont, Alain Rossier +1
Residual networks (ResNets) have displayed impressive results in pattern recognition and, recently, have garnered considerable theoretical interest due to a perceived link with neu…