339 citations · 1k across the 41 of their papers we have counts for
43 papers
Constrained Nonconvex Stochastic Optimization with One Projection
Yuyang Deng, Mohammadreza M. Kalan, Eitan J. Neugut +1
Constrained nonconvex optimization has seen increasing application in modern machine learning, such as safe LLM alignment/finetuning, transfer learning and rank-constrained continu…
Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
Yuyang Deng, Fuli Qiao, Mehrdad Mahdavi
Stochastic compositional minimax problems are prevalent in machine learning, yet there are only limited established on the convergence of this class of problems. In this paper, we…
On the Generalization Ability of Unsupervised Pretraining
Yuyang Deng, Junyuan Hong, Jiayu Zhou +1
Recent advances in unsupervised learning have shown that unsupervised pre-training, followed by fine-tuning, can improve model generalization. However, a rigorous understanding of…
Distributed Personalized Empirical Risk Minimization
Yuyang Deng, Mohammad Mahdi Kamani, Pouria Mahdavinia +1
This paper advocates a new paradigm Personalized Empirical Risk Minimization (PERM) to facilitate learning from heterogeneous data sources without imposing stringent constraints on…
Understanding Deep Gradient Leakage via Inversion Influence Functions
Haobo Zhang, Junyuan Hong, Yuyang Deng +2
Deep Gradient Leakage (DGL) is a highly effective attack that recovers private training images from gradient vectors. This attack casts significant privacy challenges on distribute…
Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation
Yuyang Deng, Ilja Kuzborskij, Mehrdad Mahdavi
We consider the problem of learning a model from multiple heterogeneous sources with the goal of performing well on a new target distribution. The goal of learner is to mix these d…