The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection

Shubhankar Mohapatra, Sajin Sasy, Xi He +2

Hyperparameter optimization is a ubiquitous challenge in machine learning, and the performance of a trained model depends crucially upon their effective selection. While a rich set…