29 citations · 45 across the 7 of their papers we have counts for
4 papers · 1 filter
Teacher Geometry Shapes Learnability in Teacher-Student Networks
Kai J. Sandbrink, Flavio Martinelli, Alexander van Meegen +2
Teacher-student systems, in which a teacher neural network generates training labels so that a student neural network can learn to implement the same function, are widely used as a…
Flat Channels to Infinity in Neural Loss Landscapes
Flavio Martinelli, Alexander Van Meegen, Berfin Şimşek +2
The loss landscapes of neural networks contain minima and saddle points that may be connected in flat regions or appear in isolation. We identify and characterize a special structu…
Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks
Ann Huang, Satpreet H. Singh, Flavio Martinelli +1
Task-trained recurrent neural networks (RNNs) are widely used in neuroscience and machine learning to model dynamical computations. To gain mechanistic insight into how neural syst…
MLPGradientFlow: going with the flow of multilayer perceptrons (and finding minima fast and accurately)
Johanni Brea, Flavio Martinelli, Berfin Şimşek +1
MLPGradientFlow is a software package to solve numerically the gradient flow differential equation , where are the parameters of a mu…