68 citations · 160 across the 28 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
stat.ML2022★ 3 cited
On the infinite-depth limit of finite-width neural networks
Soufiane Hayou
In this paper, we study the infinite-depth limit of finite-width residual neural networks with random Gaussian weights. With proper scaling, we show that by fixing the width and ta…
stat.ML2022
From Optimization Dynamics to Generalization Bounds via Łojasiewicz Gradient Inequality
Fusheng Liu, Haizhao Yang, Soufiane Hayou +1
Optimization and generalization are two essential aspects of statistical machine learning. In this paper, we propose a framework to connect optimization with generalization by anal…