25 citations · 44 across the 4 of their papers we have counts for
4 papers
Model-brain comparison using inter-animal transforms
Imran Thobani, Javier Sagastuy-Brena, Aran Nayebi +3
Artificial neural network models have emerged as promising mechanistic models of the brain. However, there is little consensus on the correct method for comparing model activations…
The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion
Daniel Kunin, Javier Sagastuy-Brena, Lauren Gillespie +4
In this work we explore the limiting dynamics of deep neural networks trained with stochastic gradient descent (SGD). As observed previously, long after performance has converged,…
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli +2
Understanding the dynamics of neural network parameters during training is one of the key challenges in building a theoretical foundation for deep learning. A central obstacle is t…
Two Routes to Scalable Credit Assignment without Weight Symmetry
Daniel Kunin, Aran Nayebi, Javier Sagastuy-Brena +3
The neural plausibility of backpropagation has long been disputed, primarily for its use of non-local weight transport the biologically dubious requirement that one neuron inst…