141 citations · 2k across the 103 of their papers we have counts for
4 papers · 1 filter
Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function
Wojciech Tarnowski, Piotr Warchoł, Stanisław Jastrzębski +2
We demonstrate that in residual neural networks (ResNets) dynamical isometry is achievable irrespectively of the activation function used. We do that by deriving, with the help of…
From synaptic interactions to collective dynamics in random neuronal networks models: critical role of eigenvectors and transient behavior
Ewa Gudowska-Nowak, Maciej A. Nowak, Dante R. Chialvo +2
The study of neuronal interactions is currently at the center of several big collaborative neuroscience projects (including the Human Connectome Project, the Blue Brain Project, th…
On the pros and cons of using temporal derivatives to assess brain functional connectivity
Jeremi K. Ochab, Wojciech Tarnowski, and Maciej A. Nowak +1
The study of correlations between brain regions is an important chapter of the analysis of large-scale brain spatiotemporal dynamics. In particular, novel methods suited to extract…
Probing non-orthogonality of eigenvectors in non-Hermitian matrix models: diagrammatic approach
Maciej A. Nowak, Wojciech Tarnowski
Using large arguments, we propose a scheme for calculating the two-point eigenvector correlation function for non-normal random matrices in the large limit. The setting gen…