115 citations · 132 across the 2 of their papers we have counts for
2 papers
cs.LG2019★ 17 cited
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape
Johanni Brea, Berfin Simsek, Bernd Illing +1
The permutation symmetry of neurons in each layer of a deep neural network gives rise not only to multiple equivalent global minima of the loss function, but also to first-order sa…
cs.NE2019★ 115 cited
Biologically plausible deep learning -- but how far can we go with shallow networks?
Bernd Illing, Wulfram Gerstner, Johanni Brea
Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate model…