Reducing Data Motion to Accelerate the Training of Deep Neural Networks

Sicong Zhuang, Cristiano Malossi, Marc Casas

This paper reduces the cost of DNNs training by decreasing the amount of data movement across heterogeneous architectures composed of several GPUs and multicore CPU devices. In par…