Information thermodynamics: from physics to neuroscience

Abstract

This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in neuroscience have been treated separately, in contrast to physics approaches, where the relationship of entropy production with heat is a central idea. It is argued here that also in neural systems information and energy can be considered within the same theoretical framework. Starting from basic ideas of thermodynamics and information theory on a classic Brownian particle, it is shown how noisy neural networks can infer its probabilistic motion. The decoding of the particle motion by neurons is performed with some accuracy and it has some energy cost, and both can be determined using information thermodynamics. In a similar fashion, we also discuss how neural networks in the brain can learn the particle velocity, and maintain that information in the weights of plastic synapses from a physical point of view. Generally, it is shown how the framework of stochastic and information thermodynamics can be used practically to study neural inference, learning, and information storing.

Perspective on application of stochastic and information thermodynamics to neuroscience (neural decoding, learning, memory)

References in corpus (24)

• Stochastic thermodynamics, fluctuation theorems, and molecular machines
• Emergent complex neural dynamics
• The Physics of Maxwell's demon and information
• Dissipation: The phase-space perspective
• The Three Faces of the Second Law: I. Master Equation Formulation
• $f$-divergence Inequalities
• The thermodynamics of prediction
• The Energetic Costs of Cellular Computation
• Mutual information between in- and output trajectories of biochemical networks
• Uncertainty relations in stochastic processes: An information inequality approach
• Thermodynamics of statistical inference by cells
• Thermodynamic efficiency of information and heat flow
• Thermodynamic constraints on neural dimensions, firing rates, brain temperature and size
• Stochastic Thermodynamics of Learning
• Metabolic constraints on synaptic learning and memory
• Mutual information disentangles interactions from changing environments
• Constancy and trade-offs in the neuroanatomical and metabolic design of the cerebral cortex
• Thermodynamic cost and benefit of memory
• Approximate invariance of metabolic energy per synapse during development in mammalian brains
• Information propagation in multilayer systems with higher-order interactions across timescales
• General H-theorem and entropies that violate the second law
• Frenetic steering in a nonequilibrium graph
• Cooperativity, information gain, and energy cost during early LTP in dendritic spines
• Bounds on the rates of statistical divergences and mutual information via stochastic thermodynamics

Cited by in corpus (1)

• Transfer Entropy and Flow of Information in Two-Skyrmion System