Stimulus-dependent maximum entropy models of neural population codes

Abstract

Neural populations encode information about their stimulus in a collective fashion, by joint activity patterns of spiking and silence. A full account of this mapping from stimulus to neural activity is given by the conditional probability distribution over neural codewords given the sensory input. To be able to infer a model for this distribution from large-scale neural recordings, we introduce a stimulus-dependent maximum entropy (SDME) model---a minimal extension of the canonical linear-nonlinear model of a single neuron, to a pairwise-coupled neural population. The model is able to capture the single-cell response properties as well as the correlations in neural spiking due to shared stimulus and due to effective neuron-to-neuron connections. Here we show that in a population of 100 retinal ganglion cells in the salamander retina responding to temporal white-noise stimuli, dependencies between cells play an important encoding role. As a result, the SDME model gives a more accurate account of single cell responses and in particular outperforms uncoupled models in reproducing the distributions of codewords emitted in response to a stimulus. We show how the SDME model, in conjunction with static maximum entropy models of population vocabulary, can be used to estimate information-theoretic quantities like surprise and information transmission in a neural population.

11 pages, 7 figures

References in corpus (10)

• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Prediction of spatio-temporal patterns of neural activity from pairwise correlations
• Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
• Small-correlation expansions for the inverse Ising problem
• Mean Field Theory For Non-Equilibrium Network Reconstruction
• Ising models for networks of real neurons
• Features and dimensions: Motion estimation in fly vision
• Faster solutions of the inverse pairwise Ising problem
• Gibbs distribution analysis of temporal correlations structure in retina ganglion cells
• Retinal adaptation and invariance to changes in higher-order stimulus statistics

Cited by in corpus (22)

• Searching for collective behavior in a network of real neurons
• Inverse statistical problems: from the inverse Ising problem to data science
• Bits from Biology for Computational Intelligence
• What do we mean by the dimensionality of behavior?
• A unifying framework for mean-field theories of asymmetric kinetic Ising systems
• Learning quadratic receptive fields from neural responses to natural stimuli
• Building population models for large-scale neural recordings: opportunities and pitfalls
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Exact computation of the Maximum Entropy Potential of spiking neural networks models
• Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations
• Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons
• Transformation of stimulus correlations by the retina
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Conditional Finite Mixtures of Poisson Distributions for Context-Dependent Neural Correlations
• Modeling the correlated activity of neural populations: A review
• Inferring Spatial Source of Disease Outbreaks using Maximum Entropy
• Entropic forces in a non-equilibrium system: Flocks of birds
• Neurons as an Information-theoretic Engine
• Habit learning supported by efficiently controlled network dynamics in naive macaque monkeys
• Thermodynamic Formalism in Neuronal Dynamics and Spike Train Statistics
• State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
• Unsupervised Bayesian Ising Approximation for revealing the neural dictionary in songbirds