163 citations · 1.2k across the 128 of their papers we have counts for
4 papers · 1 filter
Stagewise Training Accelerates Convergence of Testing Error Over SGD
Zhuoning Yuan, Yan Yan, Rong Jin +1
Stagewise training strategy is widely used for learning neural networks, which runs a stochastic algorithm (e.g., SGD) starting with a relatively large step size (aka learning rate…
Fast Rates of ERM and Stochastic Approximation: Adaptive to Error Bound Conditions
Mingrui Liu, Xiaoxuan Zhang, Lijun Zhang +2
Error bound conditions (EBC) are properties that characterize the growth of an objective function when a point is moved away from the optimal set. They have recently received incre…
A Simple Analysis for Exp-concave Empirical Minimization with Arbitrary Convex Regularizer
Tianbao Yang, Zhe Li, Lijun Zhang
In this paper, we present a simple analysis of {\bf fast rates} with {\it high probability} of {\bf empirical minimization} for {\it stochastic composite optimization} over a finit…
Hybrid safe-strong rules for efficient optimization in lasso-type problems
Yaohui Zeng, Tianbao Yang, Patrick Breheny
The lasso model has been widely used for model selection in data mining, machine learning, and high-dimensional statistical analysis. However, with the ultrahigh-dimensional, large…