71 citations · 375 across the 22 of their papers we have counts for
4 papers · 1 filter
Subgradient Descent Learns Orthogonal Dictionaries
Yu Bai, Qijia Jiang, Ju Sun
This paper concerns dictionary learning, i.e., sparse coding, a fundamental representation learning problem. We show that a subgradient descent algorithm, with random initializatio…
ProxQuant: Quantized Neural Networks via Proximal Operators
Yu Bai, Yu-Xiang Wang, Edo Liberty
To make deep neural networks feasible in resource-constrained environments (such as mobile devices), it is beneficial to quantize models by using low-precision weights. One common…
Approximability of Discriminators Implies Diversity in GANs
Yu Bai, Tengyu Ma, Andrej Risteski
While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer fro…
Analysis of Sequential Quadratic Programming through the Lens of Riemannian Optimization
Yu Bai, Song Mei
We prove that a "first-order" Sequential Quadratic Programming (SQP) algorithm for equality constrained optimization has local linear convergence with rate , where $κ_…