66 citations · 168 across the 10 of their papers we have counts for
25 papers
StepDIRECT -- A Derivative-Free Optimization Method for Stepwise Functions
Dzung T. Phan, Hongsheng Liu, Lam M. Nguyen
In this paper, we propose the StepDIRECT algorithm for derivative-free optimization (DFO), in which the black-box objective function has a stepwise landscape. Our framework is base…
FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization
Quoc Tran-Dinh, Nhan H. Pham, Dzung T. Phan +1
We develop two new algorithms, called, FedDR and asyncFedDR, for solving a fundamental nonconvex composite optimization problem in federated learning. Our algorithms rely on a nove…
A Scalable MIP-based Method for Learning Optimal Multivariate Decision Trees
Haoran Zhu, Pavankumar Murali, Dzung T. Phan +2
Several recent publications report advances in training optimal decision trees (ODT) using mixed-integer programs (MIP), due to algorithmic advances in integer programming and a gr…
SMG: A Shuffling Gradient-Based Method with Momentum
Trang H. Tran, Lam M. Nguyen, Quoc Tran-Dinh
We combine two advanced ideas widely used in optimization for machine learning: shuffling strategy and momentum technique to develop a novel shuffling gradient-based method with mo…
Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes
Marten van Dijk, Nhuong V. Nguyen, Toan N. Nguyen +3
Hogwild! implements asynchronous Stochastic Gradient Descent (SGD) where multiple threads in parallel access a common repository containing training data, perform SGD iterations an…
An Optimal Hybrid Variance-Reduced Algorithm for Stochastic Composite Nonconvex Optimization
Deyi Liu, Lam M. Nguyen, Quoc Tran-Dinh
In this note we propose a new variant of the hybrid variance-reduced proximal gradient method in [7] to solve a common stochastic composite nonconvex optimization problem under sta…