NeuroFabric: Identifying Ideal Topologies for Training A Priori Sparse Networks

Mihailo Isakov, Michel A. Kinsy

Long training times of deep neural networks are a bottleneck in machine learning research. The major impediment to fast training is the quadratic growth of both memory and compute…