A Linear Algebraic Approach to Model Parallelism in Deep Learning

Russell J. Hewett, Thomas J. Grady

Training deep neural networks (DNNs) in large-cluster computing environments is increasingly necessary, as networks grow in size and complexity. Local memory and processing limitat…