Probabilistic Rollouts for Learning Curve Extrapolation Across Hyperparameter Settings

Matilde Gargiani, Aaron Klein, Stefan Falkner +1

We propose probabilistic models that can extrapolate learning curves of iterative machine learning algorithms, such as stochastic gradient descent for training deep networks, based…