Deep Neural Network Training with Frank-Wolfe

Sebastian Pokutta, Christoph Spiegel, Max Zimmer

This paper studies the empirical efficacy and benefits of using projection-free first-order methods in the form of Conditional Gradients, a.k.a. Frank-Wolfe methods, for training N…