Task Selection for AutoML System Evaluation

Jonathan Lorraine, Nihesh Anderson, Chansoo Lee +2

Our goal is to assess if AutoML system changes - i.e., to the search space or hyperparameter optimization - will improve the final model's performance on production tasks. However,…