86 citations · 209 across the 19 of their papers we have counts for
4 papers · 1 filter
Auptimizer -- an Extensible, Open-Source Framework for Hyperparameter Tuning
Jiayi Liu, Samarth Tripathi, Unmesh Kurup +1
Tuning machine learning models at scale, especially finding the right hyperparameter values, can be difficult and time-consuming. In addition to the computational effort required,…
On-Device Machine Learning: An Algorithms and Learning Theory Perspective
Sauptik Dhar, Junyao Guo, Jiayi Liu +3
The predominant paradigm for using machine learning models on a device is to train a model in the cloud and perform inference using the trained model on the device. However, with i…
Variable Metric Proximal Gradient Method with Diagonal Barzilai-Borwein Stepsize
Youngsuk Park, Sauptik Dhar, Stephen Boyd +1
Variable metric proximal gradient (VM-PG) is a widely used class of convex optimization method. Lately, there has been a lot of research on the theoretical guarantees of VM-PG with…
Improving Model Training by Periodic Sampling over Weight Distributions
Samarth Tripathi, Jiayi Liu, Unmesh Kurup +2
In this paper, we explore techniques centered around periodic sampling of model weights that provide convergence improvements on gradient update methods (vanilla \acs{SGD}, Momentu…