Analytical and Numerical Study of Internal Representations in Multilayer Neural Networks with Binary Weights

Simona Cocco, Remi Monasson, Riccardo Zecchina

We study the weight space structure of the parity machine with binary weights by deriving the distribution of volumes associated to the internal representations of the learning exa…