252 citations · 3.3k across the 92 of their papers we have counts for
5 papers · 1 filter
Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations
Yuanzhi Li, Tengyu Ma, Hongyang Zhang
We show that the gradient descent algorithm provides an implicit regularization effect in the learning of over-parameterized matrix factorization models and one-hidden-layer neural…
Learning One-hidden-layer Neural Networks with Landscape Design
Rong Ge, Jason D. Lee, Tengyu Ma
We consider the problem of learning a one-hidden-layer neural network: we assume the input is from Gaussian distribution and the label , w…
On the Optimization Landscape of Tensor Decompositions
Rong Ge, Tengyu Ma
Non-convex optimization with local search heuristics has been widely used in machine learning, achieving many state-of-art results. It becomes increasingly important to understand…
Generalization and Equilibrium in Generative Adversarial Nets (GANs)
Sanjeev Arora, Rong Ge, Yingyu Liang +2
We show that training of generative adversarial network (GAN) may not have good generalization properties; e.g., training may appear successful but the trained distribution may be…
On the ability of neural nets to express distributions
Holden Lee, Rong Ge, Tengyu Ma +2
Deep neural nets have caused a revolution in many classification tasks. A related ongoing revolution -- also theoretically not understood -- concerns their ability to serve as gene…