37 citations · 56 across the 13 of their papers we have counts for
5 papers · 1 filter
Quasi-Self-Concordant Optimization with Lewis Weights
Alina Ene, Ta Duy Nguyen, Adrian Vladu
In this paper, we study the problem for a quasi-self-concordant function , where are $…
Improved Convergence in High Probability of Clipped Gradient Methods with Heavy Tails
Ta Duy Nguyen, Alina Ene, Huy L. Nguyen
In this work, we study the convergence \emph{in high probability} of clipped gradient methods when the noise distribution has heavy tails, ie., with bounded th moments, for some…
High Probability Convergence of Clipped-SGD Under Heavy-tailed Noise
Ta Duy Nguyen, Thien Hang Nguyen, Alina Ene +1
While the convergence behaviors of stochastic gradient methods are well understood \emph{in expectation}, there still exist many gaps in the understanding of their convergence with…
High Probability Convergence of Stochastic Gradient Methods
Zijian Liu, Ta Duy Nguyen, Thien Hang Nguyen +2
In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous w…
Adaptive Accelerated (Extra-)Gradient Methods with Variance Reduction
Zijian Liu, Ta Duy Nguyen, Alina Ene +1
In this paper, we study the finite-sum convex optimization problem focusing on the general convex case. Recently, the study of variance reduced (VR) methods and their accelerated v…