36 citations · 80 across the 13 of their papers we have counts for
3 papers · 1 filter
Pure and Spurious Critical Points: a Geometric Study of Linear Networks
Matthew Trager, Kathlén Kohn, Joan Bruna
The critical locus of the loss function of a neural network is determined by the geometry of the functional space and by the parameterization of this space by the network's weights…
Gradient Dynamics of Shallow Univariate ReLU Networks
Francis Williams, Matthew Trager, Claudio Silva +3
We present a theoretical and empirical study of the gradient dynamics of overparameterized shallow ReLU networks with one-dimensional input, solving least-squares interpolation. We…
On the Expressive Power of Deep Polynomial Neural Networks
Joe Kileel, Matthew Trager, Joan Bruna
We study deep neural networks with polynomial activations, particularly their expressive power. For a fixed architecture and activation degree, a polynomial neural network defines…