47 citations · 208 across the 28 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2019
Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets
Rohith Kuditipudi, Xiang Wang, Holden Lee +5
Mode connectivity is a surprising phenomenon in the loss landscape of deep nets. Optima -- at least those discovered by gradient-based optimization -- turn out to be connected by s…
cs.LG2019★ 9 cited
Stabilized SVRG: Simple Variance Reduction for Nonconvex Optimization
Rong Ge, Zhize Li, Weiyao Wang +1
Variance reduction techniques like SVRG provide simple and fast algorithms for optimizing a convex finite-sum objective. For nonconvex objectives, these techniques can also find a…
cs.LG2018
Learning Two-layer Neural Networks with Symmetric Inputs
Rong Ge, Rohith Kuditipudi, Zhize Li +1
We give a new algorithm for learning a two-layer neural network under a general class of input distributions. Assuming there is a ground-truth two-layer network $$ y = A σ(Wx) + ξ,…