Mutual Information of Population Codes and Distance Measures in Probability Space

Abstract

We studied the mutual information between a stimulus and a large system consisting of stochastic, statistically independent elements that respond to a stimulus. The Mutual Information (MI) of the system saturates exponentially with system size. A theory of the rate of saturation of the MI is developed. We show that this rate is controlled by a distance function between the response probabilities induced by different stimuli. This function, which we term the {\it Confusion Distance} between two probabilities, is related to the Renyi $\alpha$-Information.

11 pages, 3 figures, accepted to PRL

Cited by in corpus (9)

• Maximally Informative Stimuli and Tuning Curves for Sigmoidal Rate-Coding Neurons and Populations
• The Geometry of Information Coding in Correlated Neural Populations
• Optimal stimulus and noise distributions for information transmission via suprathreshold stochastic resonance
• Information-Theoretic Bounds and Approximations in Neural Population Coding
• Approximations of Shannon Mutual Information for Discrete Variables with Applications to Neural Population Coding
• Replica symmetric evaluation of the information transfer in a two-layer network in presence of continuous and discrete stimuli
• A theoretical model of neuronal population coding of stimuli with both continuous and discrete dimensions
• High-Fidelity Coding with Correlated Neurons
• A replica free evaluation of the neuronal population information with mixed continuous and discrete stimuli: from the linear to the asymptotic regime