Predicting the success of Gradient Descent for a particular Dataset-Architecture-Initialization (DAI)

Umangi Jain, Harish G. Ramaswamy

Despite their massive success, training successful deep neural networks still largely relies on experimentally choosing an architecture, hyper-parameters, initialization, and train…