An Introductory Review of Information Theory in the Context of Computational Neuroscience

Abstract

This paper introduces several fundamental concepts in information theory from the perspective of their origins in engineering. Understanding such concepts is important in neuroscience for two reasons. Simply applying formulae from information theory without understanding the assumptions behind their definitions can lead to erroneous results and conclusions. Furthermore, this century will see a convergence of information theory and neuroscience; information theory will expand its foundations to incorporate more comprehensively biological processes thereby helping reveal how neuronal networks achieve their remarkable information processing abilities.

18 pages, 7 figures, to appear in Biological Cybernetics

References in corpus (5)

• On directed information theory and Granger causality graphs
• Maximally Informative Stimuli and Tuning Curves for Sigmoidal Rate-Coding Neurons and Populations
• Neural Population Coding is Optimized by Discrete Tuning Curves
• Information capacity in the weak-signal approximation
• Information transfer with small-amplitude signals

Cited by in corpus (2)

• Complexity Leads to Simplicity: A Consensus Layer V Pyramidal Neuron Can Sustain Interpulse-Interval Coding
• Detecting Information Relays in Deep Neural Networks