Always-Sparse Training by Growing Connections with Guided Stochastic Exploration

Mike Heddes, Narayan Srinivasa, Tony Givargis +1

The excessive computational requirements of modern artificial neural networks (ANNs) are posing limitations on the machines that can run them. Sparsification of ANNs is often motiv…