DeepPCR: Parallelizing Sequential Operations in Neural Networks

Federico Danieli, Miguel Sarabia, Xavier Suau +2

Parallelization techniques have become ubiquitous for accelerating inference and training of deep neural networks. Despite this, several operations are still performed in a sequent…