A Solver + Gradient Descent Training Algorithm for Deep Neural Networks

Dhananjay Ashok, Vineel Nagisetty, Christopher Srinivasa +1

We present a novel hybrid algorithm for training Deep Neural Networks that combines the state-of-the-art Gradient Descent (GD) method with a Mixed Integer Linear Programming (MILP)…