Clustering of neural codewords revealed by a first-order phase transition
arXiv:1602.06630 · doi:10.1103/PhysRevE.93.062416
Abstract
A network of neurons in the central nervous system collectively represents information by its spiking activity states. Typically observed states, i.e., codewords, occupy only a limited portion of the state space due to constraints imposed by network interactions. Geometrical organization of codewords in the state space, critical for neural information processing, is poorly understood due to its high dimensionality. Here, we explore the organization of neural codewords using retinal data by computing the entropy of codewords as a function of Hamming distance from a particular reference codeword. Specifically, we report that the retinal codewords in the state space are divided into multiple distinct clusters separated by entropy-gaps, and that this structure is shared with well-known associative memory networks in a recallable phase. Our analysis also elucidates a special nature of the all-silent state. The all-silent state is surrounded by the densest cluster of codewords and located within a reachable distance from most codewords. This codeword-space structure quantitatively predicts typical deviation of a state-trajectory from its initial state. Altogether, our findings reveal a non-trivial heterogeneous structure of the codeword-space that shapes information representation in a biological network.
14 pages, 5 figures in main text plus Supplemental Material (7 pages)
References in corpus (1)
Cited by in corpus (6)
- The Structured `Low Temperature' Phase of the Retinal Population Code
- Eight challenges in developing theory of intelligence
- Role of zero synapses in unsupervised feature learning
- Data-driven effective model shows a liquid-like deep learning
- Theory of population coupling and applications to describe high order correlations in large populations of interacting neurons
- Noise-Robust Modes of the Retinal Population Code have the Geometry of "Ridges" and Correspond with Neuronal Communities