Better Schedules for Low Precision Training of Deep Neural Networks

Cameron R. Wolfe, Anastasios Kyrillidis

Low precision training can significantly reduce the computational overhead of training deep neural networks (DNNs). Though many such techniques exist, cyclic precision training (CP…