Sparse neural networks with large learning diversity

Vincent Gripon, Claude Berrou

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons.…