163 citations · 1.2k across the 128 of their papers we have counts for
6 papers · 2 filters
Stochastic Optimization for DC Functions and Non-smooth Non-convex Regularizers with Non-asymptotic Convergence
Yi Xu, Qi Qi, Qihang Lin +2
Difference of convex (DC) functions cover a broad family of non-convex and possibly non-smooth and non-differentiable functions, and have wide applications in machine learning and…
Frank-Wolfe Method is Automatically Adaptive to Error Bound Condition
Yi Xu, Tianbao Yang
Error bound condition has recently gained revived interest in optimization. It has been leveraged to derive faster convergence for many popular algorithms, including subgradient me…
First-order Convergence Theory for Weakly-Convex-Weakly-Concave Min-max Problems
Mingrui Liu, Hassan Rafique, Qihang Lin +1
In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is we…
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning
Hassan Rafique, Mingrui Liu, Qihang Lin +1
Min-max problems have broad applications in machine learning, including learning with non-decomposable loss and learning with robustness to data distribution. Convex-concave min-ma…
Katalyst: Boosting Convex Katayusha for Non-Convex Problems with a Large Condition Number
Zaiyi Chen, Yi Xu, Haoyuan Hu +1
In this paper, we propose a new SVRG-style acceleated stochastic algorithm for solving a family of non-convex optimization problems whose objective consists of a sum of smooth…
Universal Stagewise Learning for Non-Convex Problems with Convergence on Averaged Solutions
Zaiyi Chen, Zhuoning Yuan, Jinfeng Yi +3
Although stochastic gradient descent (SGD) method and its variants (e.g., stochastic momentum methods, AdaGrad) are the choice of algorithms for solving non-convex problems (especi…