4 papers
Optimal Two-Step Stepsize Schedule for Stochastic Gradient Methods
Luwei Bai, Baoyu Zhou
Structured nonconstant large stepsizes can improve the convergence of gradient descent in the deterministic setting. However, in stochastic optimization, aggressive stepsizes can a…
Exploring Effective Strategies for Building a User-Configured GPT for Coding Classroom Dialogues
Luwei Bai, Dongkeun Han, Sara Hennessy
This study investigated effective strategies for developing a custom GPT to code classroom dialogue. While classroom dialogue is widely recognised as a crucial element of education…
Generalization of Silver Stepsize Schedule to Stochastic Optimization
Luwei Bai, Yang Zeng, Baoyu Zhou
This work introduces a two-step stepsize schedule for stochastic gradient methods minimizing smooth strongly convex functions. We consider the setting where only stochastic gradien…
Avoiding strict saddle points of nonconvex regularized problems
Luwei Bai, Yaohua Hu, Hao Wang +1
In this paper, we consider a class of non-convex and non-smooth sparse optimization problems, which encompass most existing nonconvex sparsity-inducing terms. We show the second-or…