Finding trainable sparse networks through Neural Tangent Transfer

Tianlin Liu, Friedemann Zenke

Deep neural networks have dramatically transformed machine learning, but their memory and energy demands are substantial. The requirements of real biological neural networks are ra…