72 citations · 263 across the 31 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
math.OC2017★ 13 cited
"Relative-Continuity" for Non-Lipschitz Non-Smooth Convex Optimization using Stochastic (or Deterministic) Mirror Descent
Haihao Lu
The usual approach to developing and analyzing first-order methods for non-smooth (stochastic or deterministic) convex optimization assumes that the objective function is uniformly…
cs.LG2017★ 72 cited
Depth Creates No Bad Local Minima
Haihao Lu, Kenji Kawaguchi
In deep learning, \textit{depth}, as well as \textit{nonlinearity}, create non-convex loss surfaces. Then, does depth alone create bad local minima? In this paper, we prove that wi…