Zero-Shot AutoML with Pretrained Models

Ekrem Öztürk, Fabio Ferreira, Hadi S. Jomaa +3

Given a new dataset D and a low compute budget, how should we choose a pre-trained model to fine-tune to D, and set the fine-tuning hyperparameters without risking overfitting, par…