Pushing the boundaries of parallel Deep Learning -- A practical approach

Paolo Viviani, Maurizio Drocco, Marco Aldinucci

This work aims to assess the state of the art of data parallel deep neural network training, trying to identify potential research tracks to be exploited for performance improvemen…