Breaking Chains with Trees: Model-Parallel Deep Learning with $\mathcal{O}(\log N)$ Time Complexity

Neeraj Mohan Sushma, Aditya Nagarsekar, Cabrel Teguemne Fokam +4

Modern deep neural networks are trained using error backpropagation, which requires sequential forward and backward computations across network layers. As these networks become dee…