Predicting Deep Neural Network Training Outcomes from Early Training Telemetry

Ranjita Naik, Anh D. Nguyen, Pankaj Kumar Singh

Large hyperparameter sweeps for deep neural networks spend substantial compute on configurations that are effectively doomed from the first few epochs. We study whether a single tr…