Neural network relief: a pruning algorithm based on neural activity

Aleksandr Dekhovich, David M. J. Tax, Marcel H. F. Sluiter +1

Current deep neural networks (DNNs) are overparameterized and use most of their neuronal connections during inference for each task. The human brain, however, developed specialized…