125 citations · 237 across the 22 of their papers we have counts for
5 papers · 1 filter
Analytic Characterization of the Hessian in Shallow ReLU Models: A Tale of Symmetry
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layers ReLU networks with respect to the squared loss, where labels are generated by a target network. We leverage…
Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations
Yossi Arjevani, Yair Carmon, John C. Duchi +3
We design an algorithm which finds an -approximate stationary point (with ) using stochastic gradient and Hessian-vector products, matching gua…
IDEAL: Inexact DEcentralized Accelerated Augmented Lagrangian Method
Yossi Arjevani, Joan Bruna, Bugra Can +3
We introduce a framework for designing primal methods under the decentralized optimization setting where local functions are smooth and strongly convex. Our approach consists of ap…
Symmetry & critical points for a model shallow neural network
Yossi Arjevani, Michael Field
We consider the optimization problem associated with fitting two-layer ReLU networks with hidden neurons, where labels are assumed to be generated by a (teacher) neural network…
On the Complexity of Minimizing Convex Finite Sums Without Using the Indices of the Individual Functions
Yossi Arjevani, Amit Daniely, Stefanie Jegelka +1
Recent advances in randomized incremental methods for minimizing -smooth -strongly convex finite sums have culminated in tight complexity of $\tilde{O}((n+\sqrt{n L/μ})\log(1…