The mutual information of a stochastic binary channel: validity of the Replica Symmetry Ansatz

Antonio Turiel, Elka Korutcheva, Nestor Parga

We calculate the mutual information (MI) of a two-layered neural network with noiseless, continuous inputs and binary, stochastic outputs under several assumptions on the synaptic…