7 papers
Adjusted Shuffling SARAH: Advancing Complexity Analysis via Dynamic Gradient Weighting
Duc Toan Nguyen, Trang H. Tran, Lam M. Nguyen
In this paper, we propose Adjusted Shuffling SARAH, a novel algorithm that integrates shuffling strategies into the recursive SARAH framework using a dynamic weighting mechanism to…
Graph Concept Bottleneck Models
Haotian Xu, Tsui-Wei Weng, Lam M. Nguyen +1
Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existi…
Learning to Shuffle: Block Reshuffling and Reversal Schemes for Stochastic Optimization
Lam M. Nguyen, Dzung T. Phan, Jayant Kalagnanam
Shuffling strategies for stochastic gradient descent (SGD), including incremental gradient, shuffle-once, and random reshuffling, are supported by rigorous convergence analyses for…
Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Models
Yunshi Wen, Wesley M. Gifford, Chandra Reddy +3
The recent surge in Time Series Foundation Models has rapidly advanced the field, yet the heterogeneous training setups across studies make it difficult to attribute improvements t…
Probabilistic Federated Prompt-Tuning with Non-IID and Imbalanced Data
Pei-Yau Weng, Minh Hoang, Lam M. Nguyen +3
Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffect…
Stochastic ISTA/FISTA Adaptive Step Search Algorithms for Convex Composite Optimization
Lam M. Nguyen, Katya Scheinberg, Trang H. Tran
We develop and analyze stochastic variants of ISTA and a full backtracking FISTA algorithms [Beck and Teboulle, 2009, Scheinberg et al., 2014] for composite optimization without th…