What is Information?
arXiv:1601.06176 · doi:10.1098/rsta.2015.0230
Abstract
Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.
arXiv comment19 pages, 2 figures. To appear in Philosophical Transaction of the Royal Society A
References in corpus (14)
- Information theory in molecular biology
- Evolutionary instability of Zero Determinant strategies demonstrates that winning isn't everything
- Integrated information increases with fitness in the evolution of animats
- The use of information theory in evolutionary biology
- Physical Complexity of Symbolic Sequences
- The evolution of representation in simple cognitive networks
- Strong Selection Significantly Increases Epistatic Interactions in the Long-Term Evolution of a Protein
- Critical dynamics in the evolution of stochastic strategies for the iterated Prisoner's Dilemma
- Information-theoretic considerations concerning the origin of life
- The capacity of black holes to transmit quantum information
- Punishment in Public Goods games leads to meta-stable phase transitions and hysteresis
- Black holes are almost optimal quantum cloners
- One-shot decoupling and Page curves from a dynamical model for black hole evaporation
- Discovery and information-theoretic characterization of transcription factor binding sites that act cooperatively
Cited by in corpus (8)
- From the origin of life to pandemics: Emergent phenomena in complex systems
- Laplacian paths in complex networks: information core emerges from entropic transitions
- The Gibbs paradox, the Landauer principle and the irreversibility associated with tilted observers
- Quantum propensities in the brain cortex and free will
- The theory of gravitation: A tale of many questions and few answers
- Information Fragmentation, Encryption and Information Flow in Complex Biological Networks
- Rebuilding the Habitable Zone from the Bottom Up with Computational Zones
- Can Turing machine be curious about its Turing test results? Three informal lectures on physics of intelligence