24 citations · 57 across the 10 of their papers we have counts for
5 papers · 1 filter
Annihilation of Spurious Minima in Two-Layer ReLU Networks
Yossi Arjevani, Michael Field
We study the optimization problem associated with fitting two-layer ReLU neural networks with respect to the squared loss, where labels are generated by a target network. Use is ma…
Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of
Yossi Arjevani, Michael Field
Motivated by questions originating from the study of a class of shallow student-teacher neural networks, methods are developed for the analysis of spurious minima in classes of gra…
Analytic Characterization of the Hessian in Shallow ReLU Models: A Tale of Symmetry
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layers ReLU networks with respect to the squared loss, where labels are generated by a target network. We leverage…
Symmetry & critical points for a model shallow neural network
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layer ReLU networks with hidden neurons, where labels are assumed to be generated by a (teacher) neural network…
On the Principle of Least Symmetry Breaking in Shallow ReLU Models
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layer ReLU networks with respect to the squared loss, where labels are assumed to be generated by a target network.…