24 citations · 57 across the 10 of their papers we have counts for
10 papers
Annihilation of Spurious Minima in Two-Layer ReLU Networks
Yossi Arjevani, Michael Field
We study the optimization problem associated with fitting two-layer ReLU neural networks with respect to the squared loss, where labels are generated by a target network. Use is ma…
Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of
Yossi Arjevani, Michael Field
Motivated by questions originating from the study of a class of shallow student-teacher neural networks, methods are developed for the analysis of spurious minima in classes of gra…
Symmetry Breaking in Symmetric Tensor Decomposition
Yossi Arjevani, Joan Bruna, Michael Field +3
In this note, we consider the highly nonconvex optimization problem associated with computing the rank decomposition of symmetric tensors. We formulate the invariance properties of…
Analytic Characterization of the Hessian in Shallow ReLU Models: A Tale of Symmetry
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layers ReLU networks with respect to the squared loss, where labels are generated by a target network. We leverage…
Symmetry & critical points for a model shallow neural network
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layer ReLU networks with hidden neurons, where labels are assumed to be generated by a (teacher) neural network…
On the Principle of Least Symmetry Breaking in Shallow ReLU Models
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layer ReLU networks with respect to the squared loss, where labels are assumed to be generated by a target network.…