Applications of information geometry to spiking neural network behavior
arXiv:2305.07482 · doi:10.1103/PhysRevE.109.024302
Abstract
The space of possible behaviors complex biological systems may exhibit is unimaginably vast, and these systems often appear to be stochastic, whether due to variable noisy environmental inputs or intrinsically generated chaos. The brain is a prominent example of a biological system with complex behaviors. The number of possible patterns of spikes emitted by a local brain circuit is combinatorially large, though the brain may not make use of all of them. Understanding which of these possible patterns are actually used by the brain, and how those sets of patterns change as properties of neural circuitry change is a major goal in neuroscience. Recently, tools from information geometry have been used to study embeddings of probabilistic models onto a hierarchy of model manifolds that encode how model behaviors change as a function of their parameters, giving a quantitative notion of "distances" between model behaviors. We apply this method to a network model of excitatory and inhibitory neural populations to understand how the competition between membrane and synaptic response timescales shapes the network's information geometry. The hyperbolic embedding allows us to identify the statistical parameters to which the model behavior is most sensitive, and demonstrate how the ranking of these coordinates changes with the balance of excitation and inhibition in the network.
arXiv comment36 pages, 14 figures
References in corpus (17)
- Hierarchical structure and the prediction of missing links in networks
- Universally Sloppy Parameter Sensitivities in Systems Biology
- Hyperbolic Geometry of Complex Networks
- Parameter Space Compression Underlies Emergent Theories and Predictive Models
- The geometry of nonlinear least squares with applications to sloppy models and optimization
- Impact of network structure and cellular response on spike time correlations
- Why are nonlinear fits so challenging?
- Dynamics of multi-stable states during ongoing and evoked cortical activity
- Stimuli reduce the dimensionality of cortical activity
- Critical and maximally informative encoding between neural populations in the retina
- Statistical mechanics of complex neural systems and high dimensional data
- Linking structure and activity in nonlinear spiking networks
- Robust information propagation through noisy neural circuits
- Motif Statistics and Spike Correlations in Neuronal Networks
- Visualizing probabilistic models: Intensive Principal Component Analysis
- Predicting how and when hidden neurons skew measured synaptic interactions
- Visualizing probabilistic models in Minkowski space with intensive symmetrized Kullback-Leibler embedding