51 citations · 175 across the 13 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
stat.ML2018★ 15 cited
Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function
Wojciech Tarnowski, Piotr Warchoł, Stanisław Jastrzębski +2
We demonstrate that in residual neural networks (ResNets) dynamical isometry is achievable irrespectively of the activation function used. We do that by deriving, with the help of…
math-ph2018★ 19 cited
Full Dysonian dynamics of the complex Ginibre ensemble
Jacek Grela, Piotr Warchoł
We find stochastic equations governing eigenvalues and eigenvectors of a dynamical complex Ginibre ensemble reaffirming the intertwined role played between both sets of matrix degr…