Towards Hyperparameter-Agnostic DNN Training via Dynamical System Insights

Carmel Fiscko, Aayushya Agarwal, Yihan Ruan +3

We present a stochastic first-order optimization method specialized for deep neural networks (DNNs), ECCO-DNN. This method models the optimization variable trajectory as a dynamica…