2 papers
cs.LG2024
Reevaluating Theoretical Analysis Methods for Optimization in Deep Learning
Hoang Tran, Qinzi Zhang, Ashok Cutkosky
There is a significant gap between our theoretical understanding of optimization algorithms used in deep learning and their practical performance. Theoretical development usually f…
math.OC2024
Private Zeroth-Order Nonsmooth Nonconvex Optimization
Qinzi Zhang, Hoang Tran, Ashok Cutkosky
We introduce a new zeroth-order algorithm for private stochastic optimization on nonconvex and nonsmooth objectives. Given a dataset of size , our algorithm ensures …