115 citations · 189 across the 4 of their papers we have counts for
4 papers
Local plasticity rules can learn deep representations using self-supervised contrastive predictions
Bernd Illing, Jean Ventura, Guillaume Bellec +1
Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose…
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape
Johanni Brea, Berfin Simsek, Bernd Illing +1
The permutation symmetry of neurons in each layer of a deep neural network gives rise not only to multiple equivalent global minima of the loss function, but also to first-order sa…
Biologically plausible deep learning -- but how far can we go with shallow networks?
Bernd Illing, Wulfram Gerstner, Johanni Brea
Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate model…
Strain pattern in supercooled liquids
Bernd Illing, Sebastian Fritschi, David Hajnal +3
Investigations of strain correlations at the glass transition reveal unexpected phenomena. The shear strain fluctuations show an Eshelby-strain pattern (),…