Brief Announcement: On the Limits of Parallelizing Convolutional Neural Networks on GPUs

Behnam Pourghassemi, Chenghao Zhang, Joo Hwan Lee +1

GPUs are currently the platform of choice for training neural networks. However, training a deep neural network (DNN) is a time-consuming process even on GPUs because of the massiv…